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PREFACE 


This edition, like its predecessors, is written from the viewpoint of the applied 
mathematician, whose interest in differential equations may be sometimes quite 
theoretical, sometimes intensely practical, and often somewhere in between. We 
have sought to combine a sound and accurate (but not abstract) exposition of the 
elementary theory of differential equations with considerable material on methods 
of solution, analysis, and approximation that have proved useful in a wide variety of 
applications. 

The book is written primarily for undergraduate students of mathematics, science, 
or engineering, who typically take a course on differential equations during their 
first or second year of study. The main prerequisite for reading the book is a working 
knowledge of calculus, gained from a normal two- or three-semester course sequence 
or its equivalent. Some familiarity with matrices will also be helpful in the chapters 
on systems of differential equations. 

To be widely useful, a textbook must be adaptable to a variety of instructional 
strategies. This implies at least two things. First, instructors should have maximum 
flexibility to choose both the particular topics they wish to cover and the order in 
which they want to cover them. Second, the book should be useful to students who 
have access to a wide range of technological capability. 

With respect to content, we provide this flexibility by making sure that, so far as 
possible, individual chapters are independent of each other. Thus, after the basic 
parts of the first three chapters are completed (roughly Sections 1.1 through 1.3,2.1 
through 2.5, and 3.1 through 3.5), the selection of additional topics, and the order and 
depth in which they are covered, are at the discretion of the instructor. Chapters 4 
through 8 are essentially independent of each other, except that Chapter 7 should 
precede Chapter 9. This means that there are multiple pathways through the book, 
and many different combinations have been used effectively with earlier editions. 


ix 
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With respect to technology, we note repeatedly in the text that computers are ex¬ 
tremely useful for investigating differential equations and their solutions, and many 
of the problems are best approached with computational assistance. Nevertheless, 
the book is adaptable to courses having various levels of computer involvement, 
ranging from little or none to intensive. The text is independent of any particular 
hardware platform or software package. 

Many problems are marked with the symbol to indicate that we consider them 
to be technologically intensive. Computers have at least three important uses in a 
differential equations course. The first is simply to crunch numbers, thereby gen¬ 
erating accurate numerical approximations to solutions. The second is to carry out 
symbolic manipulations that would be tedious and time-consuming to do by hand. 
Finally, and perhaps most important of all, is the ability to translate the results of 
numerical or symbolic computations into graphical form, so that the behavior of 
solutions can be easily visualized. The marked problems typically involve one or 
more of these features. Naturally, the designation of a problem as technologically 
intensive is a somewhat subjective judgment, and the is intended only as a guide. 
Many of the marked problems can be solved, at least in part, without computa¬ 
tional help, and a computer can also be used effectively on many of the unmarked 
problems. 

From a student’s point of view, the problems that are assigned as homework and 
that appear on examinations drive the course. We believe that the most outstanding 
feature of this book is the number, and above all the variety and range, of the prob¬ 
lems that it contains. Many problems are entirely straightforward, but many others 
are more challenging, and some are fairly open-ended and can even serve as the basis 
for independent student projects. There are far more problems than any instructor 
can use in any given course, and this provides instructors with a multitude of choices 
in tailoring their course to meet their own goals and the needs of their students. 

The motivation for solving many differential equations is the desire to learn some¬ 
thing about an underlying physical process that the equation is believed to model. 
It is basic to the importance of differential equations that even the simplest equa¬ 
tions correspond to useful physical models, such as exponential growth and decay, 
spring-mass systems, or electrical circuits. Gaining an understanding of a complex 
natural process is usually accomplished by combining or building upon simpler and 
more basic models. Thus a thorough knowledge of these basic models, the equations 
that describe them, and their solutions is the first and indispensable step toward the 
solution of more complex and realistic problems. We describe the modeling process 
in detail in Sections 1.1,1.2, and 2.3. Careful constructions of models appear also in 
Sections 2.5 and 3.7 and in the appendices to Chapter 10. Differential equations re¬ 
sulting from the modeling process appear frequently throughout the book, especially 
in the problem sets. 

The main reason for including fairly extensive material on applications and math¬ 
ematical modeling in a book on differential equations is to persuade students that 
mathematical modeling often leads to differential equations, and that differential 
equations are part of an investigation of problems in a wide variety of other fields. 
We also emphasize the transportability of mathematical knowledge: once you mas¬ 
ter a particular solution method, you can use it in any field of application in which an 
appropriate differential equation arises. Once these points are convincingly made, 
we believe that it is unnecessary to provide specific applications of every method 



Preface 


xi 


of solution or type of equation that we consider. This helps to keep this book to 
a reasonable size, and in any case, there is only a limited time in most differential 
equations courses to discuss modeling and applications. 

Nonroutine problems often require the use of a variety of tools, both analytical 
and numerical. Paper-and-pencil methods must often be combined with effective 
use of a computer. Quantitative results and graphs, often produced by a computer, 
serve to illustrate and clarify conclusions that may be obscured by complicated ana¬ 
lytical expressions. On the other hand, the implementation of an efficient numerical 
procedure typically rests on a good deal of preliminary analysis—to determine the 
qualitative features of the solution as a guide to computation, to investigate limit¬ 
ing or special cases, or to discover which ranges of the variables or parameters may 
require or merit special attention. Thus, a student should come to realize that investi¬ 
gating a difficult problem may well require both analysis and computation; that good 
judgment may be required to determine which tool is best suited for a particular task; 
and that results can often be presented in a variety of forms. 

We believe that it is important for students to understand that (except perhaps 
in courses on differential equations) the goal of solving a differential equation is 
seldom simply to obtain the solution. Rather, we seek the solution in order to obtain 
insight into the behavior of the process that the equation purports to model. In 
other words, the solution is not an end in itself. Thus, we have included in the text 
a great many problems, as well as some examples, that call for conclusions to be 
drawn about the solution. Sometimes this takes the form of finding the value of the 
independent variable at which the solution has a certain property, or determining 
the long-term behavior of the solution. Other problems ask for the effect of variations 
in a parameter, or for the determination of a critical value of a parameter at which 
the solution experiences a substantial change. Such problems are typical of those 
that arise in the applications of differential equations, and, depending on the goals 
of the course, an instructor has the option of assigning few or many of these problems. 

Readers familiar with the preceding edition will observe that the general structure 
of the book is unchanged. The revisions that we have made in this edition are in 
many cases the result of suggestions from users of earlier editions. The goals are 
to improve the clarity and readability of our presentation of basic material about 
differential equations and their applications. More specifically, the most important 
revisions include the following: 


1. Sections 8.5 and 8.6 have been interchanged, so that the more advanced topics appear at 
the end of the chapter. 

2. Derivations and proofs in several chapters have been expanded or rewritten to provide 
more details. 

3 . The fact that the real and imaginary parts of a complex solution of a real problem are also 
solutions now appears as a theorem in Sections 3.2 and 7.4. 

4 . The treatment of generalized eigenvectors in Section 7.8 has been expanded both in the 
text and in the problems. 

5. There are about twenty new or revised problems scattered throughout the book. 

6. There are new examples in Sections 2.1,3.8, and 7.5. 

7 . About a dozen figures have been modified, mainly by using color to make the essen¬ 
tial feature of the figure more prominent. In addition, numerous captions have been 
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expanded to clarify the purpose of the figure without requiring a search of the 
surrounding text. 

8. There are several new historical footnotes, and some others have been expanded. 

The authors have found differential equations to be a never-ending source of in¬ 
teresting, and sometimes surprising, results and phenomena. We hope that users of 
this book, both students and instructors, will share our enthusiasm for the subject. 

William E. Boyce 
Grafton, New York 
March 13,2012 
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Supplemental Resources for Instructors and Students 


An Instructor’s Solutions Manual, ISBN 978-0-470-45834-1, includes solutions for all 
problems not contained in the Student Solutions Manual. 

A Student Solutions Manual, ISBN 978-0-470-45833-4, includes solutions for se¬ 
lected problems in the text. 

A Book Companion Site, www.wiley.com/college/boyce, provides a wealth of re¬ 
sources for students and instructors, including 

• PowerPoint slides of important definitions, examples, and theorems from the 
book, as well as graphics for presentation in lectures or for study and note taking. 

• Chapter Review Sheets, which enable students to test their knowledge of key 
concepts. For further review, diagnostic feedback is provided that refers to per¬ 
tinent sections in the text. 

• Mathematica, Maple, and Matlab data files for selected problems in the text 
providing opportunities for further exploration of important concepts. 

• Projects that deal with extended problems normally not included among tradi¬ 
tional topics in differential equations, many involving applications from a variety 
of disciplines. These vary in length and complexity, and they can be assigned as 
individual homework or as group assignments. 

A series of supplemental guidebooks, also published by John Wiley & Sons, can be 
used with Boyce/DiPrima in order to incorporate computing technologies into the 
course. These books emphasize numerical methods and graphical analysis, showing 
how these methods enable us to interpret solutions of ordinary differential equa¬ 
tions (ODEs) in the real world. Separate guidebooks cover each of the three major 
mathematical software formats, but the ODE subject matter is the same in each. 

• Hunt, Lipsman, Osborn, and Rosenberg, Differential Equations with Matlab , 
3rd ed., 2012, ISBN 978-1-118-37680-5 

• Hunt, Lardy, Lipsman, Osborn, and Rosenberg, Differential Equations with 
Maple , 3rd ed., 2008, ISBN 978-0-471-77317-7 

• Hunt, Outing, Lipsman, Osborn, and Rosenberg, Differential Equations with 
Mathematica , 3rd ed., 2009, ISBN 978-0-471-77316-0 


WileyPLUS 

WileyPLUS WileyPLUS is an innovative, research-based online environment for effective teach¬ 
ing and learning. 

WileyPLUS builds students’ confidence because it takes the guesswork out of 
studying by providing students with a clear roadmap: what to do, how to do it, if they 
did it right. Students will take more initiative so you’ll have greater impact on their 
achievement in the classroom and beyond. 

WileyPLUS , is loaded with all of the supplements above, and it also features 

• The E-book, which is an exact version of the print text but also features hyper¬ 
links to questions, definitions, and supplements for quicker and easier support. 





XIV 


Preface 


• Guided Online (GO) Exercises, which prompt students to build solutions step- 
by-step. Rather than simply grading an exercise answer as wrong, GO problems 
show students precisely where they are making a mistake. 

• Homework management tools, which enable instructors easily to assign and 
grade questions, as well as to gauge student comprehension. 

• QuickStart pre-designed reading and homework assignments. Use them as is, 
or customize them to fit the needs of your classroom. 

• Interactive Demonstrations, based on figures from the text, which help reinforce 
and deepen understanding of the key concepts of differential equations. Use 
them in class or assign them as homework. Worksheets are provided to help 
guide and structure the experience of mastering these concepts. 
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CHAPTER 


1 


Introduction 


In this chapter we give perspective to your study of differential equations in several 
different ways. First, we use two problems to illustrate some of the basic ideas that we 
will return to, and elaborate upon, frequently throughout the remainder of the book. 
Later, to provide organizational structure for the book, we indicate several ways 
of classifying differential equations. Finally, we outline some of the major trends 
in the historical development of the subject and mention a few of the outstanding 
mathematicians who have contributed to it. The study of differential equations has 
attracted the attention of many of the world’s greatest mathematicians during the 
past three centuries. Nevertheless, it remains a dynamic field of inquiry today, with 
many interesting open questions. 


1.1 Some Basic Mathematical Models; Direction Fields 


Before embarking on a serious study of differential equations (for example, by read¬ 
ing this book or major portions of it), you should have some idea of the possible 
benefits to be gained by doing so. For some students the intrinsic interest of the 
subject itself is enough motivation, but for most it is the likelihood of important 
applications to other fields that makes the undertaking worthwhile. 

Many of the principles, or laws, underlying the behavior of the natural world are 
statements or relations involving rates at which things happen. When expressed 
in mathematical terms, the relations are equations and the rates are derivatives. 
Equations containing derivatives are differential equations. Therefore, to understand 
and to investigate problems involving the motion of fluids, the flow of current in elec¬ 
tric circuits, the dissipation of heat in solid objects, the propagation and detection of 
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Chapter 1 . Introduction 


EXAMPLE 

1 

A Falling 
Object 


seismic waves, or the increase or decrease of populations, among many others, it is 
necessary to know something about differential equations. 

A differential equation that describes some physical process is often called a math¬ 
ematical model of the process, and many such models are discussed throughout this 
book. In this section we begin with two models leading to equations that are easy to 
solve. It is noteworthy that even the simplest differential equations provide useful 
models of important physical processes. 

Suppose that an object is falling in the atmosphere near sea level. Formulate a differential 
equation that describes the motion. 

We begin by introducing letters to represent various quantities that may be of interest in this 
problem. The motion takes place during a certain time interval, so let us use t to denote time. 
Also, let us use v to represent the velocity of the falling object. The velocity will presumably 
change with time, so we think of v as a function of t; in other words, t is the independent 
variable and v is the dependent variable. The choice of units of measurement is somewhat 
arbitrary, and there is nothing in the statement of the problem to suggest appropriate units, 
so we are free to make any choice that seems reasonable. To be specific, let us measure time 
t in seconds and velocity v in meters/second. Further, we will assume that v is positive in the 
downward direction—that is, when the object is falling. 

The physical law that governs the motion of objects is Newton’s second law, which states 
that the mass of the object times its acceleration is equal to the net force on the object. In 
mathematical terms this law is expressed by the equation 

F = ma, (1) 

where m is the mass of the object, a is its acceleration, and F is the net force exerted on the 
object. To keep our units consistent, we will measure m in kilograms, a in meters/second 2 , and 
F in newtons. Of course, a is related to v by a = dv/dt, so we can rewrite Eq. (1) in the form 

F = m(dv/dt). (2) 

Next, consider the forces that act on the object as it falls. Gravity exerts a force equal to 
the weight of the object, or mg, where g is the acceleration due to gravity. In the units we have 
chosen, g has been determined experimentally to be approximately equal to 9.8 m/s 2 near 
the earth’s surface. There is also a force due to air resistance, or drag, that is more difficult to 
model. This is not the place for an extended discussion of the drag force; suffice it to say that it 
is often assumed that the drag is proportional to the velocity, and we will make that assumption 
here. Thus the drag force has the magnitude yv, where y is a constant called the drag coefficient. 
The numerical value of the drag coefficient varies widely from one object to another; smooth 
streamlined objects have much smaller drag coefficients than rough blunt ones. The physical 
units for y are mass/time, or kg/s for this problem; if these units seem peculiar, remember that 
yv must have the units of force, namely, kg-m/s 2 . 

In writing an expression for the net force F, we need to remember that gravity always acts 
in the downward (positive) direction, whereas, for a falling object, drag acts in the upward 
(negative) direction, as shown in Figure 1.1.1. Thus 

F = mg — yv (3) 

and Eq. (2) then becomes 

dv 

m— = mg — yv. (4) 

dt 


Equation (4) is a mathematical model of an object falling in the atmosphere near sea level. 
Note that the model contains the three constants m, g, and y. The constants m and y depend 
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very much on the particular object that is falling, and they are usually different for different 
objects. It is common to refer to them as parameters, since they may take on a range of values 
during the course of an experiment. On the other hand, g is a physical constant, whose value 
is the same for all objects. 


yv 

O m 

mg 

FIGURE 1.1.1 Free-body diagram of the forces on a falling object. 


To solve Eq. (4), we need to find a function v = v(t) that satisfies the equation. It 
is not hard to do this, and we will show you how in the next section. For the present, 
however, let us see what we can learn about solutions without actually finding any of 
them. Our task is simplified slightly if we assign numerical values to m and y, but the 
procedure is the same regardless of which values we choose. So, let us suppose that 
m = 10 kg and y = 2 kg/s. Then Eq. (4) can be rewritten as 


— = 9.8 — 
dt 5 


( 5 ) 


EXAMPLE 

2 


A Falling 
Object 
(continued) 


Investigate the behavior of solutions of Eq. (5) without solving the differential equation. 

First let us consider what information can be obtained directly from the differential equation 
itself. Suppose that the velocity v has a certain given value. Then, by evaluating the right side of 
Eq. (5), we can find the corresponding value of dv/dt. For instance, if v = 40, then dv/dt = 1.8. 
This means that the slope of a solution v = v(t) has the value 1.8 at any point where v = 40. 
We can display this information graphically in the tv -plane by drawing short line segments 
with slope 1.8 at several points on the line v = 40. Similarly, if v = 50, then dv/dt = —0.2, so 
we draw line segments with slope —0.2 at several points on the line v = 50. We obtain Figure 
1.1.2 by proceeding in the same way with other values of v. Figure 1.1.2 is an example of what 
is called a direction field or sometimes a slope field. 

Remember that a solution of Eq. (5) is a function v = v(t) whose graph is a curve in the 
tu-plane. The importance of Figure 1.1.2 is that each line segment is a tangent line to one 
of these solution curves. Thus, even though we have not found any solutions, and no graphs of 
solutions appear in the figure, we can nonetheless draw some qualitative conclusions about 
the behavior of solutions. For instance, if v is less than a certain critical value, then all the line 
segments have positive slopes, and the speed of the falling object increases as it falls. On the 
other hand, if v is greater than the critical value, then the line segments have negative slopes, 
and the falling object slows down as it falls. What is this critical value of v that separates objects 
whose speed is increasing from those whose speed is decreasing? Referring again to Eq. (5), 
we ask what value of v will cause dv/dt to be zero. The answer is v = (5) (9.8) = 49 m/s. 

In fact, the constant function v(t) = 49 is a solution of Eq. (5). To verify this statement, 
substitute v(t) = 49 into Eq. (5) and observe that each side of the equation is zero. Because 
it does not change with time, the solution v(t) = 49 is called an equilibrium solution. It is 
the solution that corresponds to a perfect balance between gravity and drag. In Figure 1.1.3 
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we show the equilibrium solution v(t) = 49 superimposed on the direction field. From this 
figure we can draw another conclusion, namely, that all other solutions seem to be converging 
to the equilibrium solution as t increases. Thus, in this context, the equilibrium solution is often 
called the terminal velocity. 




FIGURE 1.1.3 Direction field and equilibrium solution for Eq. (5): dv/dt = 9.8 - 0/5). 


The approach illustrated in Example 2 can be applied equally well to the more 
general Eq. (4), where the parameters m and y are unspecified positive numbers. 
The results are essentially identical to those of Example 2. The equilibrium solution 
of Eq. (4) is v(t) = mg/y. Solutions below the equilibrium solution increase with time, 
those above it decrease with time, and all other solutions approach the equilibrium 
solution as t becomes large. 
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Direction Fields. Direction fields are valuable tools in studying the solutions of 
differential equations of the form 

f=/«,y>. (6) 

where / is a given function of the two variables t and y, sometimes referred to as the 
rate function. A direction field for equations of the form (6) can be constructed by 
evaluating / at each point of a rectangular grid. At each point of the grid, a short line 
segment is drawn whose slope is the value of / at that point. Thus each line segment 
is tangent to the graph of the solution passing through that point. A direction field 
drawn on a fairly fine grid gives a good picture of the overall behavior of solutions of 
a differential equation. Usually a grid consisting of a few hundred points is sufficient. 
The construction of a direction field is often a useful first step in the investigation of 
a differential equation. 

Two observations are worth particular mention. First, in constructing a direction 
field, we do not have to solve Eq. (6); we just have to evaluate the given function 
fit , y ) many times. Thus direction fields can be readily constructed even for equations 
that may be quite difficult to solve. Second, repeated evaluation of a given function 
is a task for which a computer is well suited, and you should usually use a computer 
to draw a direction field. All the direction fields shown in this book, such as the one 
in Figure 1.1.2, were computer-generated. 


Field Mice and Owls. Now let us look at another, quite different example. Consider 
a population of field mice who inhabit a certain rural area. In the absence of 
predators we assume that the mouse population increases at a rate proportional 
to the current population. This assumption is not a well-established physical law 
(as Newton’s law of motion is in Example 1), but it is a common initial hypothesis 1 
in a study of population growth. If we denote time by t and the mouse population by 
pit), then the assumption about population growth can be expressed by the equation 



( 7 ) 


where the proportionality factor r is called the rate constant or growth rate. To be 
specific, suppose that time is measured in months and that the rate constant r has the 
value 0.5/month. Then each term in Eq. (7) has the units of mice/month. 

Now let us add to the problem by supposing that several owls live in the same 
neighborhood and that they kill 15 field mice per day. To incorporate this information 
into the model, we must add another term to the differential equation (7), so that it 
becomes 

/ = 0.5p - 450. (8) 

dt 


Observe that the predation term is —450 rather than —15 because time is measured 
in months, so the monthly predation rate is needed. 


X A better model of population growth is discussed in Section 2.5. 
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EXAMPLE 

3 


Investigate the solutions of Eq. (8) graphically. 

A direction field for Eq. (8) is shown in Figure 1.1.4. For sufficiently large values of p it can 
be seen from the figure, or directly from Eq. (8) itself, that dp/dt is positive, so that solutions 
increase. On the other hand, if p is small, then dp/dt is negative and solutions decrease. Again, 
the critical value of p that separates solutions that increase from those that decrease is the 
value of p for which dp/dt is zero. By setting dp/dt equal to zero in Eq. (8) and then solving 
for p, we find the equilibrium solution pit) = 900, for which the growth term and the predation 
term in Eq. (8) are exactly balanced. The equilibrium solution is also shown in Figure 1.1.4. 



FIGURE 1.1.4 Direction field and equilibrium solution for Eq. (8): dp/dt = 0.5 p — 450. 

Comparing Examples 2 and 3, we note that in both cases the equilibrium solution 
separates increasing from decreasing solutions. In Example 2 other solutions con¬ 
verge to, or are attracted by, the equilibrium solution, so that after the object falls far 
enough, an observer will see it moving at very nearly the equilibrium velocity. On 
the other hand, in Example 3 other solutions diverge from, or are repelled by, the 
equilibrium solution. Solutions behave very differently depending on whether they 
start above or below the equilibrium solution. As time passes, an observer might see 
populations either much larger or much smaller than the equilibrium population, but 
the equilibrium solution itself will not, in practice, be observed. In both problems, 
however, the equilibrium solution is very important in understanding how solutions 
of the given differential equation behave. 

A more general version of Eq. (8) is 

f = rp - k - < 9) 

where the growth rate r and the predation rate k are unspecified. Solutions of this 
more general equation are very similar to those of Eq. (8). The equilibrium solution 
of Eq. (9) is pit) = k/r. Solutions above the equilibrium solution increase, while 
those below it decrease. 

You should keep in mind that both of the models discussed in this section have 
their limitations. The model (5) of the falling object is valid only as long as the 







1.1 Some Basic Mathematical Models; Direction Fields 


7 


object is falling freely, without encountering any obstacles. The population model 
(8) eventually predicts negative numbers of mice (if p < 900) or enormously large 
numbers (if p > 900). Both of these predictions are unrealistic, so this model becomes 
unacceptable after a fairly short time interval. 

Constructing Mathematical Models. In applying differential equations to any of the 
numerous fields in which they are useful, it is necessary first to formulate the appro¬ 
priate differential equation that describes, or models, the problem being investigated. 
In this section we have looked at two examples of this modeling process, one drawn 
from physics and the other from ecology. In constructing future mathematical mod¬ 
els yourself, you should recognize that each problem is different, and that successful 
modeling cannot be reduced to the observance of a set of prescribed rules. Indeed, 
constructing a satisfactory model is sometimes the most difficult part of the problem. 
Nevertheless, it may be helpful to list some steps that are often part of the process: 

1. Identify the independent and dependent variables and assign letters to represent them. 
Often the independent variable is time. 

2. Choose the units of measurement for each variable. In a sense the choice of units is 
arbitrary, but some choices may be much more convenient than others. For example, we 
chose to measure time in seconds for the falling-object problem and in months for the 
population problem. 

3. Articulate the basic principle that underlies or governs the problem you are investigating. 
This may be a widely recognized physical law, such as Newton’s law of motion, or it may be 
a more speculative assumption that may be based on your own experience or observations. 
In any case, this step is likely not to be a purely mathematical one, but will require you to 
be familiar with the field in which the problem originates. 

4. Express the principle or law in step 3 in terms of the variables you chose in step 1. This 
may be easier said than done. It may require the introduction of physical constants or 
parameters (such as the drag coefficient in Example 1) and the determination of appro¬ 
priate values for them. Or it may involve the use of auxiliary or intermediate variables 
that must then be related to the primary variables. 

5. Make sure that all terms in your equation have the same physical units. If this is not the 
case, then your equation is wrong and you should seek to repair it. If the units agree, then 
your equation at least is dimensionally consistent, although it may have other shortcomings 
that this test does not reveal. 

6. In the problems considered here, the result of step 4 is a single differential equation, which 
constitutes the desired mathematical model. Keep in mind, though, that in more complex 
problems the resulting mathematical model may be much more complicated, perhaps 
involving a system of several differential equations, for example. 


PROBLEMS In each of Problems 1 through 6, draw a direction field for the given differential equation. 

Based on the direction field, determine the behavior of y as t oo. If this behavior depends 
on the initial value of y at t = 0, describe the dependency. 


41 

x. 
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In each of Problems 7 through 10, write down a differential equation of the form 
dy/dt = ay + b whose solutions have the required behavior as t oo. 

7. All solutions approach y = 3. 8. All solutions approach y = 2/3. 

9. All other solutions diverge from y = 2. 10. All other solutions diverge from y = 1/3. 

In each of Problems 11 through 14, draw a direction field for the given differential equation. 
Based on the direction field, determine the behavior of y as t oo. If this behavior depends 
on the initial value of y at t = 0, describe this dependency. Note that in these problems the 
equations are not of the form y' = ay + b, and the behavior of their solutions is somewhat 
more complicated than for the equations in the text. 

41 ii- y = y ( 4 -y) & 12 - y = -y ( 5 - y) 

41 is. y = f 4L 14 y'=y(y - 2 ) 2 

Consider the following list of differential equations, some of which produced the direction 
fields shown in Figures 1.1.5 through 1.1.10. In each of Problems 15 through 20 identify the 
differential equation that corresponds to the given direction field. 


X. 

II 

1 

1—>■ 

(b) y = 2+y 

(c) y = y - 2 

(d) y' = y(y + 3) 

(e) y =y(y- 3) 

x. 

II 

+ 

(g) y - -2 - y 
(j) / = 2-y 

(h) y = y(3 — y) 

& 

1 

II 

"X 

15. The direction field of Figure 1.1.5. 

16. The direction field of Figure 1.1.6. 





17. The direction field of Figure 1.1.7. 

18. The direction field of Figure 1.1.8. 
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FIGURE 1.1.7 Problem 17. FIGURE 1.1.8 Problem 18. 
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19. The direction field of Figure 1.1.9. 

20. The direction field of Figure 1.1.10. 




FIGURE 1.1.10 Problem 20. 


21. A pond initially contains 1,000,000 gal of water and an unknown amount of an undesirable 
chemical. Water containing 0.01 g of this chemical per gallon flows into the pond at a rate 
of 300 gal/h. The mixture flows out at the same rate, so the amount of water in the pond 
remains constant. Assume that the chemical is uniformly distributed throughout the pond. 

(a) Write a differential equation for the amount of chemical in the pond at any time. 

(b) How much of the chemical will be in the pond after a very long time? Does this limiting 
amount depend on the amount that was present initially? 

22. A spherical raindrop evaporates at a rate proportional to its surface area. Write a 
differential equation for the volume of the raindrop as a function of time. 

23. Newton’s law of cooling states that the temperature of an object changes at a rate propor¬ 
tional to the difference between the temperature of the object itself and the temperature 
of its surroundings (the ambient air temperature in most cases). Suppose that the ambient 
temperature is 70°F and that the rate constant is 0.05 (min) -1 . Write a differential equation 
for the temperature of the object at any time. Note that the differential equation is the 
same whether the temperature of the object is above or below the ambient temperature. 

24. A certain drug is being administered intravenously to a hospital patient. Fluid containing 
5 mg/cm 3 of the drug enters the patient’s bloodstream at a rate of 100 cm 3 /h. The drug is 
absorbed by body tissues or otherwise leaves the bloodstream at a rate proportional to 
the amount present, with a rate constant of 0.4 (h) -1 . 

(a) Assuming that the drug is always uniformly distributed throughout the bloodstream, 
write a differential equation for the amount of the drug that is present in the bloodstream 
at any time. 

(b) How much of the drug is present in the bloodstream after a long time? 

25. For small, slowly falling objects, the assumption made in the text that the drag force 
is proportional to the velocity is a good one. For larger, more rapidly falling objects, it is 
more accurate to assume that the drag force is proportional to the square of the velocity. 2 
(a) Write a differential equation for the velocity of a falling object of mass m if the mag¬ 
nitude of the drag force is proportional to the square of the velocity and its direction is 
opposite to that of the velocity. 


2 See Lyle N. Long and Howard Weiss, “The Velocity Dependence of Aerodynamic Drag: A Primer for 
Mathematicians,” American Mathematical Monthly 106 (1999), 2, pp. 127-135. 
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(b) Determine the limiting velocity after a long time. 

(c) If m = 10 kg, find the drag coefficient so that the limiting velocity is 49 m/s. 

(d) Using the data in part (c), draw a direction field and compare it with Figure 1.1.3. 

In each of Problems 26 through 33, draw a direction field for the given differential equation. 
Based on the direction field, determine the behavior of y as t oo. If this behavior depends 
on the initial value of y at t = 0, describe this dependency. Note that the right sides of these 
equations depend on t as well as y\ therefore, their solutions can exhibit more complicated 
behavior than those in the text. 


4fl 26. y' = -2 + t-y 
28. y' = e~' +y 
30. y = 3 sin t + 1 + y 
4fl 32. y = ~(2t + y)/2y 


27. y = te~ 2t - 2 y 
29. y' = t + 2y 
4b 31. y' = 2t — 1 — y 2 
33. y' = \y 3 -y-\t 2 


1.2 Solutions of Some Differential Equations 


In the preceding section we derived the differential equations 


dv 

m — = mg — yv 


a) 


and 



( 2 ) 


Equation (1) models a falling object, and Eq. (2) models a population of field mice 
preyed on by owls. Both of these equations are of the general form 



( 3 ) 


where a and b are given constants. We were able to draw some important qualitative 
conclusions about the behavior of solutions of Eqs. (1) and (2) by considering the 
associated direction fields. To answer questions of a quantitative nature, however, we 
need to find the solutions themselves, and we now investigate how to do that. 


Consider the equation 



EXAMPLE 


( 4 ) 


1 


which describes the interaction of certain populations of field mice and owls [see Eq. (8) of 


Fi e 1 d M i c e Section 1.1]. Find solutions of this equation. 

and Owls To solve Eq. (4), we need to find functions p(t) that, when substituted into the equation, 


(continued) reduce it to an obvious identity. Here is one way to proceed. First, rewrite Eq. (4) in the form 


dp p — 900 
dt 2 


( 5 ) 


dp/dt 1 


p - 900 2 


or, if p ^ 900, 


(6) 
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By the chain rule the left side of Eq. (6) is the derivative of In |p — 9001 with respect to t, so we 
have 

| In |p-900| = 1 (7) 

Then, by integrating both sides of Eq. (7), we obtain 

In |p-900| = l - + C, (8) 

where C is an arbitrary constant of integration. Therefore, by taking the exponential of both 
sides of Eq. (8), we find that 


|p - 900| = e (,/2)+c = e c e t/2 , 


(9) 


or 

p - 900 = ±e c e‘ /2 , 


and finally 


p = 900 + ce t/2 , 


( 10 ) 

( 11 ) 


where c = ±e c is also an arbitrary (nonzero) constant. Note that the constant function p = 900 
is also a solution of Eq. (5) and that it is contained in the expression (11) if we allow c to take 
the value zero. Graphs of Eq. (11) for several values of c are shown in Figure 1.2.1. 



FIGURE 1.2.1 Graphs of p = 900 + ce t/2 for several values of c. 
These are solutions of dp/dt = 0.5 p — 450. 


Note that they have the character inferred from the direction field in Figure 1.1.4. For 
instance, solutions lying on either side of the equilibrium solution p = 900 tend to diverge 
from that solution. 


In Example 1 we found infinitely many solutions of the differential equation (4), 
corresponding to the infinitely many values that the arbitrary constant c in Eq. (11) 
might have. This is typical of what happens when you solve a differential equation. The 
solution process involves an integration, which brings with it an arbitrary constant, 
whose possible values generate an infinite family of solutions. 
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Frequently, we want to focus our attention on a single member of the infinite family 
of solutions by specifying the value of the arbitrary constant. Most often, we do this 
indirectly by specifying instead a point that must lie on the graph of the solution. For 
example, to determine the constant c in Eq. (11), we could require that the population 
have a given value at a certain time, such as the value 850 at time t — 0. In other words, 
the graph of the solution must pass through the point (0,850). Symbolically, we can 
express this condition as 

p( 0) = 850. (12) 

Then, substituting t — 0 and p = 850 into Eq. (11), we obtain 

850 = 900 + c. 


Hence c = —50, and by inserting this value into Eq. (11), we obtain the desired 
solution, namely, 

p = 900 - 50e l/2 . (13) 


The additional condition (12) that we used to determine c is an example of an 
initial condition. The differential equation (4) together with the initial condition (12) 
form an initial value problem. 

Now consider the more general problem consisting of the differential equation (3) 


and the initial condition 

y(0) = y 0 . 


(14) 


where yo is an arbitrary initial value. We can solve this problem by the same method 
as in Example 1. If a ^ 0 and y ^ b/a, then we can rewrite Eq. (3) as 


dy/dt 
y - (b/a) 

By integrating both sides, we find that 


(15) 


In |y — (b/a) | = at + C, 


(16) 


where C is arbitrary. Then, taking the exponential of both sides of Eq. (16) and solving 
for y, we obtain 

y = (b/a) + ce at , (17) 

where c = ±e c is also arbitrary. Observe that c = 0 corresponds to the equilibrium 
solution y = b/a. Finally, the initial condition (14) requires that c = yo — (b/a), so 
the solution of the initial value problem (3), (14) is 

y = (b/a) + [yo - (b/a)]e at . (18) 


For a / 0 the expression (17) contains all possible solutions of Eq. (3) and is called 
the general solution . 3 The geometrical representation of the general solution (17) is 
an infinite family of curves called integral curves. Each integral curve is associated 
with a particular value of c and is the graph of the solution corresponding to that 


3 If a = 0, then the solution of Eq. (3) is not given by Eq. (17). We leave it to you to find the general solution 
in this case. 
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value of c. Satisfying an initial condition amounts to identifying the integral curve 
that passes through the given initial point. 

To relate the solution (18) to Eq. (2), which models the field mouse population, we 
need only replace a by the growth rate r and replace b by the predation rate k. Then 
the solution (18) becomes 

p = 0 k/r ) + |p 0 - ( k/r)]e rt , (19) 

where po is the initial population of field mice. The solution (19) confirms the conclu¬ 
sions reached on the basis of the direction field and Example 1. If po = k/r, then from 
Eq. (19) it follows that p = k/r for all t\ this is the constant, or equilibrium, solution. 
If po 7 ^ k/r, then the behavior of the solution depends on the sign of the coefficient 
Po ~ (k/r) of the exponential term in Eq. (19). If po > /c/r, then/? grows exponentially 
with time t\ if po < k/r, then p decreases and eventually becomes zero, corresponding 
to extinction of the field mouse population. Negative values of p, while possible for 
the expression (19), make no sense in the context of this particular problem. 

To put the falling-object equation (1) in the form (3), we must identify a with — y/m 
and b with —g. Making these substitutions in the solution (18), we obtain 

V = (mg/y ) + | L'o - ( mg/y)]e~ rt/m , (20) 

where do is the initial velocity. Again, this solution confirms the conclusions reached 
in Section 1.1 on the basis of a direction field. There is an equilibrium, or constant, 
solution v = mg/y, and all other solutions tend to approach this equilibrium solution. 
The speed of convergence to the equilibrium solution is determined by the exponent 
—y/m. Thus, for a given mass m, the velocity approaches the equilibrium value more 
rapidly as the drag coefficient y increases. 


EXAMPLE 

2 


A Falling 
Object 
(continued) 


Suppose that, as in Example 2 of Section 1.1, we consider a falling object of mass m = 10 kg 
and drag coefficient y = 2 kg/s. Then the equation of motion (1) becomes 


dv 

dt 



( 21 ) 


Suppose this object is dropped from a height of 300 m. Find its velocity at any time t. How 
long will it take to fall to the ground, and how fast will it be moving at the time of impact? 

The first step is to state an appropriate initial condition for Eq. (21). The word “dropped” in 
the statement of the problem suggests that the initial velocity is zero, so we will use the initial 
condition 

v(0) = 0. (22) 


The solution of Eq. (21) can be found by substituting the values of the coefficients into the 
solution (20), but we will proceed instead to solve Eq. (21) directly. First,rewrite the equation as 


dv/dt 
v — 49 


1 


(23) 


By integrating both sides, we obtain 

In |u — 49| = - t - + C, (24) 

and then the general solution of Eq. (21) is 


-t /5 


v = 49 + ce 


(25) 
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where c is arbitrary. To determine c, we substitute t = 0 and v = 0 from the initial condition 
(22) into Eq. (25), with the result that c = —49. Then the solution of the initial value problem 
(21), (22) is 

v = 49(1 — e~ tf5> ). (26) 

Equation (26) gives the velocity of the falling object at any positive time (before it hits the 
ground, of course). 

Graphs of the solution (25) for several values of c are shown in Figure 1.2.2, with the solution 
(26) shown by the black curve. It is evident that all solutions tend to approach the equilibrium 
solution v = 49. This confirms the conclusions we reached in Section 1.1 on the basis of the 
direction fields in Figures 1.1.2 and 1.1.3. 



FIGURE 1.2.2 Graphs of the solution (25), v = 49 + ce t/5 , for several 
values of c. The black curve corresponds to the initial condition u(0) = 0. 


To find the velocity of the object when it hits the ground, we need to know the time at which 
impact occurs. In other words, we need to determine how long it takes the object to fall 300 m. 
To do this, we note that the distance x the object has fallen is related to its velocity v by the 
equation v = dx/dt , or 

d y 

— = 49(1 - e~ l/5 ). (27) 

dt 

Consequently, by integrating both sides of Eq. (27), we have 

x = 49 1 + 2A5e~ t/5 + c, (28) 

where c is an arbitrary constant of integration. The object starts to fall when t = 0, so we know 
that x = 0 when t = 0. From Eq. (28) it follows that c = —245, so the distance the object has 
fallen at time t is given by 

x = 49t + 245e- r/5 -245. (29) 

Let T be the time at which the object hits the ground; thenx = 300 when t—T. By substituting 
these values in Eq. (29), we obtain the equation 


49T + 245e -r/5 — 545 = 0. 


(30) 














1.2 Solutions of Some Differential Equations 


15 


The value of T satisfying Eq. (30) can be approximated by a numerical process * * * 4 using a scientific 
calculator or computer, with the result that T = 10.51s. At this time, the corresponding velocity 
vt is found from Eq. (26) to be vj = 43.01 m/s. The point (10.51,43.01) is also shown in 
Figure 1.2.2. 

Further Remarks on Mathematical Modeling. Up to this point we have related our discus¬ 
sion of differential equations to mathematical models of a falling object and of a 
hypothetical relation between field mice and owls. The derivation of these models 
may have been plausible, and possibly even convincing, but you should remember 
that the ultimate test of any mathematical model is whether its predictions agree 
with observations or experimental results. We have no actual observations or exper¬ 
imental results to use for comparison purposes here, but there are several sources of 
possible discrepancies. 

In the case of the falling object, the underlying physical principle (Newton’s law 
of motion) is well established and widely applicable. However, the assumption that 
the drag force is proportional to the velocity is less certain. Even if this assumption is 
correct, the determination of the drag coefficient y by direct measurement presents 
difficulties. Indeed, sometimes one finds the drag coefficient indirectly—for example, 
by measuring the time of fall from a given height and then calculating the value of y 
that predicts this observed time. 

The model of the field mouse population is subject to various uncertainties. 
The determination of the growth rate r and the predation rate k depends on 
observations of actual populations, which may be subject to considerable variation. 
The assumption that r and k are constants may also be questionable. For example, 
a constant predation rate becomes harder to sustain as the field mouse population 
becomes smaller. Further, the model predicts that a population above the equilib¬ 
rium value will grow exponentially larger and larger. This seems at variance with the 
behavior of actual populations; see the further discussion of population dynamics in 
Section 2.5. 

If the differences between actual observations and a mathematical model’s pre¬ 
dictions are too great, then you need to consider refining the model, making more 
careful observations, or perhaps both. There is almost always a tradeoff between 
accuracy and simplicity. Both are desirable, but a gain in one usually involves a loss 
in the other. However, even if a mathematical model is incomplete or somewhat inac¬ 
curate, it may nevertheless be useful in explaining qualitative features of the problem 
under investigation. It may also give satisfactory results under some circumstances 
but not others. Thus you should always use good judgment and common sense in 
constructing mathematical models and in using their predictions. 


PROBLEMS 4fi 1. Solve each of the following initial value problems and plot the solutions for several values 

of yo. Then describe in a few words how the solutions resemble, and differ from, each 

other. 

(a) dy/dt = -y + 5, y(0) = y 0 


4 A computer algebra system provides this capability; many calculators also have built-in routines for 
solving such equations. 
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(b) dy/dt = -2y + 5, y( 0) = y 0 

(c) dy/dt = -2y + 10, y(0) = y 0 

2. Follow the instructions for Problem 1 for the following initial value problems: 

(a) dy/dt = y - 5, y( 0) = y 0 

(b) dy/dt = 2y-5, y(0) = y 0 

(c) dy/dt = 2y — 10, y(0) = y 0 

3. Consider the differential equation 

dy/dt = —ay + b, 

where both a and b are positive numbers. 

(a) Find the general solution of the differential equation. 

(b) Sketch the solution for several different initial conditions. 

(c) Describe how the solutions change under each of the following conditions: 

i. a increases. 

ii. b increases. 

iii. Both a and b increase, but the ratio b/a remains the same. 

4. Consider the differential equation dy/dt = ay — b. 

(a) Find the equilibrium solution y e . 

(b) Let Y(t) = y — y e ; thus Y(t) is the deviation from the equilibrium solution. Find the 
differential equation satisfied by Y(t). 

5. Undetermined Coefficients. Here is an alternative way to solve the equation 

dy/dt = ay — b. (i) 

(a) Solve the simpler equation 

dy/dt = ay. (ii) 

Call the solution y\(t). 

(b) Observe that the only difference between Eqs. (i) and (ii) is the constant — b in Eq. (i). 
Therefore, it may seem reasonable to assume that the solutions of these two equations 
also differ only by a constant. Test this assumption by trying to find a constant k such that 
y = y\(t) + k is a solution of Eq. (i). 

(c) Compare your solution from part (b) with the solution given in the text in Eq. (17). 
Note: This method can also be used in some cases in which the constant b is replaced 
by a function g(t). It depends on whether you can guess the general form that the solution 
is likely to take. This method is described in detail in Section 3.5 in connection with second 
order equations. 

6. Use the method of Problem 5 to solve the equation 

dy/dt = —ay + b. 

7. The field mouse population in Example 1 satisfies the differential equation 

dp/dt = 0.5 p — 450. 

(a) Find the time at which the population becomes extinct if p( 0) = 850. 

(b) Find the time of extinction if p(0) = p 0 , where 0 < p 0 < 900. 

(c) Find the initial population p 0 if the population is to become extinct in 1 year. 
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8. Consider a population p of field mice that grows at a rate proportional to the current 
population, so that dp/dt = rp. 

(a) Find the rate constant r if the population doubles in 30 days. 

(b) Find r if the population doubles in N days. 

9. The falling object in Example 2 satisfies the initial value problem 

dv/dt = 9.8 — (v/5), u(0) = 0. 

(a) Find the time that must elapse for the object to reach 98% of its limiting velocity. 

(b) How far does the object fall in the time found in part (a)? 

10. Modify Example 2 so that the falling object experiences no air resistance. 

(a) Write down the modified initial value problem. 

(b) Determine how long it takes the object to reach the ground. 

(c) Determine its velocity at the time of impact. 

^2/ 11. Consider the falling object of mass 10 kg in Example 2, but assume now that the drag force 
is proportional to the square of the velocity. 

(a) If the limiting velocity is 49 m/s (the same as in Example 2), show that the equation 
of motion can be written as 


dv/dt = [(49) 2 - a 2 ]/245. 


Also see Problem 25 of Section 1.1. 

(b) If u(0) = 0, find an expression for v(t) at any time. 

(c) Plot your solution from part (b) and the solution (26) from Example 2 on the same 
axes. 

(d) Based on your plots in part (c), compare the effect of a quadratic drag force with that 
of a linear drag force. 

(e) Find the distance x(t) that the object falls in time t. 

(f) Find the time T it takes the object to fall 300 m. 

12. A radioactive material, such as the isotope thorium-234, disintegrates at a rate proportional 
to the amount currently present. If Q{t) is the amount present at time t, then dQ/dt = —rQ, 
where r > 0 is the decay rate. 

(a) If 100 mg of thorium-234 decays to 82.04 mg in 1 week, determine the decay rate r. 

(b) Find an expression for the amount of thorium-234 present at any time t. 

(c) Find the time required for the thorium-234 to decay to one-half its original amount. 

13. The half-life of a radioactive material is the time required for an amount of this material 
to decay to one-half its original value. Show that for any radioactive material that decays 
according to the equation Q = —rQ, the half-life r and the decay rate r satisfy the equation 
rz = In 2. 

14. Radium-226 has a half-life of 1620 years. Find the time period during which a given amount 
of this material is reduced by one-quarter. 

15. According to Newton’s law of cooling (see Problem 23 of Section 1.1), the temperature 
u(t) of an object satisfies the differential equation 


du 

dt 


—k(u — T), 


where T is the constant ambient temperature and k is a positive constant. Suppose that 
the initial temperature of the object is w(0) = u 0 . 

(a) Find the temperature of the object at any time. 
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(b) Let r be the time at which the initial temperature difference u 0 — T has been reduced 
by half. Find the relation between k and r. 

16. Suppose that a building loses heat in accordance with Newton’s law of cooling (see Problem 
15) and that the rate constant k has the value 0.15 hr 1 . Assume that the interior temperature 
is 70°F when the heating system fails. If the external temperature is 10°F, how long will it 
take for the interior temperature to fall to 32°F? 

17. Consider an electric circuit containing a capacitor, resistor, and battery; see Figure 1.2.3. 
The charge Q{t) on the capacitor satisfies the equation 5 


dQ Q 

R l + h v > 


where R is the resistance, C is the capacitance, and V is the constant voltage supplied by 
the battery. 

(a) If Q(0) = 0, find Q{t) at any time t , and sketch the graph of Q versus t. 

(b) Find the limiting value Q L that Q(t) approaches after a long time. 

(c) Suppose that Q(h) = Q L and that at time t = t\ the battery is removed and the circuit 
is closed again. Find Q(t) for t > t\ and sketch its graph. 


R 



C 

FIGURE 1.2.3 The electric circuit of Problem 17. 


18. A pond containing 1,000,000 gal of water is initially free of a certain undesirable chemical 
(see Problem 21 of Section 1.1). Water containing 0.01 g/gal of the chemical flows into the 
pond at a rate of 300 gal/h, and water also flows out of the pond at the same rate. Assume 
that the chemical is uniformly distributed throughout the pond. 

(a) Let <2(0 be the amount of the chemical in the pond at time t. Write down an initial 
value problem for Q(t). 

(b) Solve the problem in part (a) for <2(0- How much chemical is in the pond after 1 year? 

(c) At the end of 1 year the source of the chemical in the pond is removed; thereafter 
pure water flows into the pond, and the mixture flows out at the same rate as before. Write 
down the initial value problem that describes this new situation. 

(d) Solve the initial value problem in part (c). How much chemical remains in the pond 
after 1 additional year (2 years from the beginning of the problem)? 

(e) How long does it take for Q{t) to be reduced to 10 g? 

(f) Plot Q(t) versus t for 3 years. 

19. Your swimming pool containing 60,000 gal of water has been contaminated by 5 kg of 
a nontoxic dye that leaves a swimmer’s skin an unattractive green. The pool’s filtering 
system can take water from the pool, remove the dye, and return the water to the pool at 
a flow rate of 200 gal/min. 


5 This equation results from Kirchhoff’s laws, which are discussed in Section 3.7. 
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(a) Write down the initial value problem for the filtering process; let q(t) be the amount 
of dye in the pool at any time t. 

(b) Solve the problem in part (a). 

(c) You have invited several dozen friends to a pool party that is scheduled to begin in 4 h. 
You have also determined that the effect of the dye is imperceptible if its concentration 
is less than 0.02 g/gal. Is your filtering system capable of reducing the dye concentration 
to this level within 4 h? 

(d) Find the time T at which the concentration of dye first reaches the value 0.02 g/gal. 

(e) Find the flow rate that is sufficient to achieve the concentration 0.02 g/gal within 4 h. 


1.3 Classification of Differential Equations 


The main purpose of this book is to discuss some of the properties of solutions of 
differential equations, and to present some of the methods that have proved effective 
in finding solutions or, in some cases, approximating them. To provide a framework 
for our presentation, we describe here several useful ways of classifying differential 
equations. 


Ordinary and Partial Differential Equations. One important classification is based on 
whether the unknown function depends on a single independent variable or on sev¬ 
eral independent variables. In the first case, only ordinary derivatives appear in the 
differential equation, and it is said to be an ordinary differential equation. In the sec¬ 
ond case, the derivatives are partial derivatives, and the equation is called a partial 
differential equation. 

All the differential equations discussed in the preceding two sections are ordinary 
differential equations. Another example of an ordinary differential equation is 


<PQ(t) 

dt 2 


R 


dQ(t) 

dt 


+ - Q(t ) = E(t), 


( 1 ) 


for the charge Q(t) on a capacitor in a circuit with capacitance C, resistance R , and 
inductance L; this equation is derived in Section 3.7. Typical examples of partial 
differential equations are the heat conduction equation 


and the wave equation 


2 d 2 u(x, t) du(x, t) 

dx 2 ~ dt 

( 2 ) 

,3 2 u(x,t) d 2 u(x,t) 

dx 2 dt 2 

( 3 ) 


Here, a 2 and a 2 are certain physical constants. Note that in both Eqs. (2) and (3) the 
dependent variable u depends on the two independent variables x and t. The heat 
conduction equation describes the conduction of heat in a solid body, and the wave 
equation arises in a variety of problems involving wave motion in solids or fluids. 


Systems of Differential Equations. Another classification of differential equations de¬ 
pends on the number of unknown functions that are involved. If there is a single 
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function to be determined, then one equation is sufficient. However, if there are two 
or more unknown functions, then a system of equations is required. For example, the 
Lotka-Volterra, or predator-prey, equations are important in ecological modeling. 
They have the form 


dx/dt = ax — axy 
dy/dt = —cy + yxy, 


( 4 ) 


where x{t) and y(t) are the respective populations of the prey and predator species. 
The constants a , a , c, and y are based on empirical observations and depend on the 
particular species being studied. Systems of equations are discussed in Chapters 7 
and 9; in particular, the Lotka-Volterra equations are examined in Section 9.5. In 
some areas of application it is not unusual to encounter very large systems containing 
hundreds, or even many thousands, of equations. 


Order. The order of a differential equation is the order of the highest derivative that 
appears in the equation. The equations in the preceding sections are all first order 
equations, whereas Eq. (1) is a second order equation. Equations (2) and (3) are 
second order partial differential equations. More generally, the equation 

F[t,u(t),u\t),...,u (n \t)] =0 (5) 

is an ordinary differential equation of the nth order. Equation (5) expresses a relation 
between the independent variable t and the values of the function u and its first n 
derivatives u', u ",..., u^ n \ It is convenient and customary in differential equations to 
write y for u(t ), with ... ,y (n) standing for u'(t ), u"(t ),..., u (n \t). Thus Eq. (5) is 
written as 

F(t,y,y',...,y M ) = 0. (6) 


For example, 


y'" + 2e t y"+yy' = t A 


( 7 ) 


is a third order differential equation for y = u(t). Occasionally, other letters will be 
used instead of t and y for the independent and dependent variables; the meaning 
should be clear from the context. 

We assume that it is always possible to solve a given ordinary differential equation 
for the highest derivative, obtaining 

y (n) = (8) 


This is mainly to avoid the ambiguity that may arise because a single equation of 
the form (6) may correspond to several equations of the form (8). For example, the 
equation 

Cy') 2 + ty' + 4y = 0 (9) 


leads to the two equations 


-t + y/1 2 1 6y 


or y 


-t — y/t 2 — 1 6y 


( 10 ) 


Linear and Nonlinear Equations. A crucial classification of differential equations is 
whether they are linear or nonlinear. The ordinary differential equation 


F(t,y,y (n) ) = 0 
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is said to be linear if F is a linear function of the variables y,y f ,... ,y (n) ; a similar 
definition applies to partial differential equations. Thus the general linear ordinary 
differential equation of order n is 

ao(t)y (n) + +-f a n (t)y = g(t). (11) 

Most of the equations you have seen thus far in this book are linear; examples are 
the equations in Sections 1.1 and 1.2 describing the falling object and the field mouse 
population. Similarly, in this section, Eq. (1) is a linear ordinary differential equation 
and Eqs. (2) and (3) are linear partial differential equations. An equation that is not 
of the form (11) is a nonlinear equation. Equation (7) is nonlinear because of the 
term yy'. Similarly, each equation in the system (4) is nonlinear because of the terms 
that involve the product xy. 

A simple physical problem that leads to a nonlinear differential equation is the 
oscillating pendulum. The angle 0 that an oscillating pendulum of length L makes 
with the vertical direction (see Figure 1.3.1) satisfies the equation 

W + L sinS = 0 ’ < 12 > 

whose derivation is outlined in Problems 29 through 31. The presence of the term 
involving sin 0 makes Eq. (12) nonlinear. 



mg 

FIGURE 1.3.1 An oscillating pendulum. 


The mathematical theory and methods for solving linear equations are highly 
developed. In contrast, for nonlinear equations the theory is more complicated, and 
methods of solution are less satisfactory. In view of this, it is fortunate that many 
significant problems lead to linear ordinary differential equations or can be approx¬ 
imated by linear equations. For example, for the pendulum, if the angle 0 is small, 
then sin 0 = 0 and Eq. (12) can be approximated by the linear equation 


d 2 0 g 

-jy + -^-0 = 0. 

dt 2 L 


(13) 


This process of approximating a nonlinear equation by a linear one is called lineariza¬ 
tion; it is an extremely valuable way to deal with nonlinear equations. Nevertheless, 
there are many physical phenomena that simply cannot be represented adequately 
by linear equations. To study these phenomena, it is essential to deal with nonlinear 
equations. 
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In an elementary text it is natural to emphasize the simpler and more straight¬ 
forward parts of the subject. Therefore, the greater part of this book is devoted to 
linear equations and various methods for solving them. However, Chapters 8 and 9, 
as well as parts of Chapter 2, are concerned with nonlinear equations. Whenever it 
is appropriate, we point out why nonlinear equations are, in general, more difficult 
and why many of the techniques that are useful in solving linear equations cannot 
be applied to nonlinear equations. 

Solutions. A solution of the ordinary differential equation (8) on the interval 
a < t < p is a function 0 such that 0', 0 ",..., 0 (w) exist and satisfy 

<p in) (t) (i4) 

for every t in a < t < ft. Unless stated otherwise, we assume that the function / 
of Eq. (8) is a real-valued function, and we are interested in obtaining real-valued 
solutions y = 0(0- 

Recall that in Section 1.2 we found solutions of certain equations by a process of 
direct integration. For instance, we found that the equation 

^ = 0.5p - 450 (15) 

has the solution 

p = 900 + ce t/2 , (16) 

where c is an arbitrary constant. It is often not so easy to find solutions of differential 
equations. However, if you find a function that you think may be a solution of a given 
equation, it is usually relatively easy to determine whether the function is actually a 
solution simply by substituting the function into the equation. For example, in this 
way it is easy to show that the function yi(t) = cos t is a solution of 

f + y = o (17) 

for all t. To confirm this, observe that y[(t) = — sint and y"(t) = —cost; then it follows 
that y’[(t) + yiit) = 0. In the same way you can easily show that y 2 (t) = sin t is also 
a solution of Eq. (17). Of course, this does not constitute a satisfactory way to solve 
most differential equations, because there are far too many possible functions for you 
to have a good chance of finding the correct one by a random choice. Nevertheless, 
you should realize that you can verify whether any proposed solution is correct by 
substituting it into the differential equation. This can be a very useful check; it is one 
that you should make a habit of considering. 

Some Important Questions. Although for the equations (15) and (17) we are able to 
verify that certain simple functions are solutions, in general we do not have such 
solutions readily available. Thus a fundamental question is the following: Does an 
equation of the form (8) always have a solution? The answer is “No.” Merely writing 
down an equation of the form (8) does not necessarily mean that there is a function 
y = 0(0 that satisfies it. So, how can we tell whether some particular equation has a 
solution? This is the question of existence of a solution, and it is answered by theorems 
stating that under certain restrictions on the function/ in Eq. (8), the equation always 
has solutions. This is not a purely mathematical concern for at least two reasons. 
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If a problem has no solution, we would prefer to know that fact before investing 
time and effort in a vain attempt to solve the problem. Further, if a sensible physical 
problem is modeled mathematically as a differential equation, then the equation 
should have a solution. If it does not, then presumably there is something wrong with 
the formulation. In this sense an engineer or scientist has some check on the validity 
of the mathematical model. 

If we assume that a given differential equation has at least one solution, then 
we may need to consider how many solutions it has, and what additional conditions 
must be specified to single out a particular solution. This is the question of uniqueness. 
In general, solutions of differential equations contain one or more arbitrary con¬ 
stants of integration, as does the solution (16) of Eq. (15). Equation (16) represents 
an infinity of functions corresponding to the infinity of possible choices of the con¬ 
stant c. As we saw in Section 1.2, if p is specified at some time t, this condition will 
determine a value for c; even so, we have not yet ruled out the possibility that there 
may be other solutions of Eq. (15) that also have the prescribed value of p at the 
prescribed time t. As in the question of existence of solutions, the issue of uniqueness 
has practical as well as theoretical implications. If we are fortunate enough to find a 
solution of a given problem, and if we know that the problem has a unique solution, 
then we can be sure that we have completely solved the problem. If there may be 
other solutions, then perhaps we should continue to search for them. 

A third important question is: Given a differential equation of the form (8), can 
we actually determine a solution, and if so, how? Note that if we find a solution of 
the given equation, we have at the same time answered the question of the exis¬ 
tence of a solution. However, without knowledge of existence theory we might, 
for example, use a computer to find a numerical approximation to a “solution” 
that does not exist. On the other hand, even though we may know that a solution 
exists, it may be that the solution is not expressible in terms of the usual elemen¬ 
tary functions—polynomial, trigonometric, exponential, logarithmic, and hyperbolic 
functions. Unfortunately, this is the situation for most differential equations. Thus, 
we discuss both elementary methods that can be used to obtain exact solutions of 
certain relatively simple problems, and also methods of a more general nature that 
can be used to find approximations to solutions of more difficult problems. 

Computer Use in Differential Equations. A computer can be an extremely valuable tool 
in the study of differential equations. For many years computers have been used 
to execute numerical algorithms, such as those described in Chapter 8, to construct 
numerical approximations to solutions of differential equations. These algorithms 
have been refined to an extremely high level of generality and efficiency. A few lines 
of computer code, written in a high-level programming language and executed (often 
within a few seconds) on a relatively inexpensive computer, suffice to approximate to 
a high degree of accuracy the solutions of a wide range of differential equations. More 
sophisticated routines are also readily available. These routines combine the ability 
to handle very large and complicated systems with numerous diagnostic features that 
alert the user to possible problems as they are encountered. 

The usual output from a numerical algorithm is a table of numbers, listing selected 
values of the independent variable and the corresponding values of the dependent 
variable. With appropriate software it is easy to display the solution of a differen¬ 
tial equation graphically, whether the solution has been obtained numerically or as 
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the result of an analytical procedure of some kind. Such a graphical display is often 
much more illuminating and helpful in understanding and interpreting the solution of 
a differential equation than a table of numbers or a complicated analytical formula. 
There are on the market several well-crafted and relatively inexpensive special- 
purpose software packages for the graphical investigation of differential equations. 
The widespread availability of personal computers has brought powerful computa¬ 
tional and graphical capability within the reach of individual students. You should 
consider, in the light of your own circumstances, how best to take advantage of the 
available computing resources. You will surely find it enlightening to do so. 

Another aspect of computer use that is very relevant to the study of differential 
equations is the availability of extremely powerful and general software packages 
that can perform a wide variety of mathematical operations. Among these are Maple, 
Mathematica, and M ATLAB, each of which can be used on various kinds of personal 
computers or workstations. All three of these packages can execute extensive numer¬ 
ical computations and have versatile graphical facilities. Maple and Mathematica also 
have very extensive analytical capabilities. For example, they can perform the ana¬ 
lytical steps involved in solving many differential equations, often in response to a 
single command. Anyone who expects to deal with differential equations in more 
than a superficial way should become familiar with at least one of these products and 
explore the ways in which it can be used. 

For you, the student, these computing resources have an effect on how you should 
study differential equations. To become confident in using differential equations, it 
is essential to understand how the solution methods work, and this understanding is 
achieved, in part, by working out a sufficient number of examples in detail. However, 
eventually you should plan to delegate as many as possible of the routine (often 
repetitive) details to a computer, while you focus on the proper formulation of the 
problem and on the interpretation of the solution. Our viewpoint is that you should 
always try to use the best methods and tools available for each task. In particular, 
you should strive to combine numerical, graphical, and analytical methods so as to 
attain maximum understanding of the behavior of the solution and of the underlying 
process that the problem models. You should also remember that some tasks can best 
be done with pencil and paper, while others require a calculator or computer. Good 
judgment is often needed in selecting an effective combination. 


PROBLEMS 


In each of Problems 1 through 6, determine the order of the given differential equation; also 
state whether the equation is linear or nonlinear. 


„ 9 d 2 y dy 

1. t ——r + t ——K 2 y = sin t 
dt 2 dt 

. d 4 5 * 7 y d?y d 2 y dy 

dt 4 dt 3 dt 2 dt y 

d 2 y 

5. ——r + sin(7 + y) = sin t 
at 2 


4 !+</ = » 

6. + t^j- + (cos * 1 2 t)y = t 3 

at 3 at 


In each of Problems 7 through 14, verify that each given function is a solution of the differ¬ 
ential equation. 

7. y" - y = 0; 


y\{t) = e\ y 2 (t) = coslu 
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8. y" + 2/ - 3y = 0; y x (t) = , y 2 (0 = e f 

9. ty' - y = t 2 \ y = 3t + t 2 

10. y"" + 4y"' + 3y = t; yi (t) = t/3, y 2 (t) = e + t/3 

11. 2/ t2 / / + 3r/ - y = 0, t > 0; yi(0 = t 1/2 , y 2 (t) = r 1 

12. t 2 y" + 5t/ + 4y = 0, t > 0; y\{t) = t ~ 2 , y 2 (t) = t~ 2 In t 

13. y" + y = sect, 0 < t < jt/ 2; y = (cos t) In cos t + t sint 

14. y — 2ty = 1; y = f e~ s2 ds + 

Jo 

In each of Problems 15 through 18, determine the values of r for which the given differential 
equation has solutions of the form y = e rt . 

15. y + 2y = 0 16. f -y = 0 

17. / + y - 6y = 0 18. y'" - 3y" + 2/ = 0 

In each of Problems 19 and 20, determine the values of r for which the given differential 
equation has solutions of the form y = t r for t > 0. 

19. t 2 y" + 4 ty + 2y = 0 20. t 2 y" - 4ty' + 4y = 0 

In each of Problems 21 through 24, determine the order of the given partial differential equa¬ 
tion; also state whether the equation is linear or nonlinear. Partial derivatives are denoted by 
subscripts. 

21. U xx “b Uyy + U zz — 0 22. ll xx + liyy ~\~ UU X UUy “b U = 0 

23. U XXXX “b 2 U XX yy + Hyyyy - 0 24. Ilf 4" UU X - 1 U xx 

In each of Problems 25 through 28, verify that each given function is a solution of the given 
partial differential equation. 

25. u xx + Uyy = 0; u\{x,y) = cosxcoshy, u 2 (x,y) = \n(x 2 +y 2 ) 

26. a 2 u xx = u t ; u\{x,t) = e~ a2t smx, u 2 (x,t) = e~ a2) " 2t sinXx, X areal constant 

27. a 2 u xx = u tt ; U\(x,t) = sin Xx sin Xat, u 2 (x,t ) = sin(x — at), X a real constant 

28. a 2 u xx = u t ; u = {7i/t) 1/2 e~ x2/Aa2t , t > 0 

29. Follow the steps indicated here to derive the equation of motion of a pendulum, Eq. (12) 
in the text. Assume that the rod is rigid and weightless, that the mass is a point mass, and 
that there is no friction or drag anywhere in the system. 

(a) Assume that the mass is in an arbitrary displaced position, indicated by the angle 6. 
Draw a free-body diagram showing the forces acting on the mass. 

(b) Apply Newton’s law of motion in the direction tangential to the circular arc on which 
the mass moves. Then the tensile force in the rod does not enter the equation. Observe 
that you need to find the component of the gravitational force in the tangential direc¬ 
tion. Observe also that the linear acceleration, as opposed to the angular acceleration, is 
Ld 2 0/dt 2 , where L is the length of the rod. 

(c) Simplify the result from part (b) to obtain Eq. (12) in the text. 

30. Another way to derive the pendulum equation (12) is based on the principle of 
conservation of energy. 

(a) Show that the kinetic energy T of the pendulum in motion is 



(b) Show that the potential energy V of the pendulum, relative to its rest position, is 

V = mgL( 1 — cos 0). 
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(c) By the principle of conservation of energy, the total energy E = T + V is constant. 
Calculate dE/dt, set it equal to zero, and show that the resulting equation reduces to 
Eq. (12). 

31. A third derivation of the pendulum equation depends on the principle of angular 
momentum: The rate of change of angular momentum about any point is equal to the 
net external moment about the same point. 

(a) Show that the angular momentum M , or moment of momentum, about the point of 
support is given by M = mL 2 d6/dt. 

(b) Set dM/dt equal to the moment of the gravitational force, and show that the resulting 
equation reduces to Eq. (12). Note that positive moments are counterclockwise. 


1.4 Historical Remarks 


Without knowing something about differential equations and methods of solving 
them, it is difficult to appreciate the history of this important branch of mathematics. 
Further, the development of differential equations is intimately interwoven with the 
general development of mathematics and cannot be separated from it. Nevertheless, 
to provide some historical perspective, we indicate here some of the major trends in 
the history of the subject and identify the most prominent early contributors. Other 
historical information is contained in footnotes scattered throughout the book and 
in the references listed at the end of the chapter. 

The subject of differential equations originated in the study of calculus by Isaac 
Newton (1642-1727) and Gottfried Wilhelm Leibniz (1646-1716) in the seventeenth 
century. Newton grew up in the English countryside, was educated at Trinity Col¬ 
lege, Cambridge, and became Lucasian Professor of Mathematics there in 1669. His 
epochal discoveries of calculus and of the fundamental laws of mechanics date from 
1665. They were circulated privately among his friends, but Newton was extremely 
sensitive to criticism and did not begin to publish his results until 1687 with the 
appearance of his most famous book, Philosophiae Naturalis Principia Mathemat- 
ica. Although Newton did relatively little work in differential equations as such, his 
development of the calculus and elucidation of the basic principles of mechanics pro¬ 
vided a basis for their applications in the eighteenth century, most notably by Euler. 
Newton classified first order differential equations according to the three forms 
dy/dx =/(jc), dy/dx = f(y), and dy/dx =f(x,y). For the latter equation he devel¬ 
oped a method of solution using infinite series when f(x,y ) is a polynomial in x 
and y. Newton’s active research in mathematics ended in the early 1690s, except for 
the solution of occasional “challenge problems” and the revision and publication of 
results obtained much earlier. He was appointed Warden of the British Mint in 1696 
and resigned his professorship a few years later. He was knighted in 1705 and, upon 
his death, was buried in Westminster Abbey. 

Leibniz was born in Leipzig and completed his doctorate in philosophy at the age 
of 20 at the University of Altdorf. Throughout his life he engaged in scholarly work in 
several different fields. He was mainly self-taught in mathematics, since his interest 
in this subject developed when he was in his twenties. Leibniz arrived at the funda¬ 
mental results of calculus independently, although a little later than Newton, but was 
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the first to publish them, in 1684. Leibniz was very conscious of the power of good 
mathematical notation and was responsible for the notation dy/dx for the deriva¬ 
tive and for the integral sign. He discovered the method of separation of variables 
(Section 2.2) in 1691, the reduction of homogeneous equations to separable ones 
(Section 2.2, Problem 30) in 1691, and the procedure for solving first order linear 
equations (Section 2.1) in 1694. He spent his life as ambassador and adviser to sev¬ 
eral German royal families, which permitted him to travel widely and to carry on an 
extensive correspondence with other mathematicians, especially the Bernoulli broth¬ 
ers. In the course of this correspondence many problems in differential equations 
were solved during the latter part of the seventeenth century. 

The brothers Jakob (1654-1705) and Johann (1667-1748) Bernoulli of Basel did 
much to develop methods of solving differential equations and to extend the range 
of their applications. Jakob became professor of mathematics at Basel in 1687, and 
Johann was appointed to the same position upon his brother’s death in 1705. Both 
men were quarrelsome, jealous, and frequently embroiled in disputes, especially with 
each other. Nevertheless, both also made significant contributions to several areas of 
mathematics. With the aid of calculus, they solved a number of problems in mechanics 
by formulating them as differential equations. For example, Jakob Bernoulli solved 
the differential equation y' = [a 3 /{b 2 y — a 3 )] 1/2 in 1690 and, in the same paper, first 
used the term “integral” in the modern sense. In 1694 Johann Bernoulli was able 
to solve the equation dy/dx = y/ax. One problem which both brothers solved, and 
which led to much friction between them, was the brachistochrone problem (see 
Problem 32 of Section 2.3). The brachistochrone problem was also solved by Leibniz, 
Newton, and the Marquis de L’Hopital. It is said, perhaps apocryphally, that Newton 
learned of the problem late in the afternoon of a tiring day at the Mint and solved it 
that evening after dinner. He published the solution anonymously, but upon seeing 
it, Johann Bernoulli exclaimed, “Ah, I know the lion by his paw.” 

Daniel Bernoulli (1700-1782), son of Johann, migrated to St. Petersburg as a young 
man to join the newly established St. Petersburg Academy but returned to Basel 
in 1733 as professor of botany and, later, of physics. His interests were primarily in 
partial differential equations and their applications. For instance, it is his name that 
is associated with the Bernoulli equation in fluid mechanics. He was also the first 
to encounter the functions that a century later became known as Bessel functions 
(Section 5.7). 

The greatest mathematician of the eighteenth century, Leonhard Euler (1707- 
1783), grew up near Basel and was a student of Johann Bernoulli. He followed his 
friend Daniel Bernoulli to St. Petersburg in 1727. For the remainder of his life he 
was associated with the St. Petersburg Academy (1727-1741 and 1766-1783) and 
the Berlin Academy (1741-1766). Euler was the most prolific mathematician of all 
time; his collected works fill more than 70 large volumes. His interests ranged over 
all areas of mathematics and many fields of application. Even though he was blind 
during the last 17 years of his life, his work continued undiminished until the very day 
of his death. Of particular interest here is his formulation of problems in mechanics 
in mathematical language and his development of methods of solving these mathe¬ 
matical problems. Lagrange said of Euler’s work in mechanics, “The first great work 
in which analysis is applied to the science of movement.” Among other things, Euler 
identified the condition for exactness of first order differential equations (Section 
2.6) in 1734-35, developed the theory of integrating factors (Section 2.6) in the same 
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paper, and gave the general solution of homogeneous linear equations with constant 
coefficients (Sections 3.1,3.3,3.4, and 4.2) in 1743. He extended the latter results to 
nonhomogeneous equations in 1750-51. Beginning about 1750, Euler made frequent 
use of power series (Chapter 5) in solving differential equations. He also proposed 
a numerical procedure (Sections 2.7 and 8.1) in 1768-69, made important contribu¬ 
tions in partial differential equations, and gave the first systematic treatment of the 
calculus of variations. 

Joseph-Louis Lagrange (1736-1813) became professor of mathematics in his native 
Turin at the age of 19. He succeeded Euler in the chair of mathematics at the Berlin 
Academy in 1766 and moved on to the Paris Academy in 1787. He is most famous for 
his monumental work Mecanique analytique , published in 1788, an elegant and com¬ 
prehensive treatise of Newtonian mechanics. With respect to elementary differential 
equations, Lagrange showed in 1762-65 that the general solution of an nth order 
linear homogeneous differential equation is a linear combination of n independent 
solutions (Sections 3.2 and 4.1). Later, in 1774-75, he gave a complete development 
of the method of variation of parameters (Sections 3.6 and 4.4). Lagrange is also 
known for fundamental work in partial differential equations and the calculus of 
variations. 

Pierre-Simon de Laplace (1749-1827) lived in Normandy as a boy but came to 
Paris in 1768 and quickly made his mark in scientific circles, winning election to the 
Academie des Sciences in 1773. He was preeminent in the field of celestial mechanics; 
his greatest work, Traite de mecanique celeste , was published in five volumes between 
1799 and 1825. Laplace’s equation is fundamental in many branches of mathematical 
physics, and Laplace studied it extensively in connection with gravitational attraction. 
The Laplace transform (Chapter 6) is also named for him, although its usefulness in 
solving differential equations was not recognized until much later. 

By the end of the eighteenth century many elementary methods of solving ordinary 
differential equations had been discovered. In the nineteenth century interest turned 
more toward the investigation of theoretical questions of existence and uniqueness 
and to the development of less elementary methods such as those based on power 
series expansions (see Chapter 5). These methods find their natural setting in the com¬ 
plex plane. Consequently, they benefitted from, and to some extent stimulated, the 
more or less simultaneous development of the theory of complex analytic functions. 
Partial differential equations also began to be studied intensively, as their crucial role 
in mathematical physics became clear. In this connection a number of functions, aris¬ 
ing as solutions of certain ordinary differential equations, occurred repeatedly and 
were studied exhaustively. Known collectively as higher transcendental functions, 
many of them are associated with the names of mathematicians, including Bessel, 
Legendre, Hermite, Chebyshev, and Hankel, among others. 

The numerous differential equations that resisted solution by analytical means 
led to the investigation of methods of numerical approximation (see Chapter 8). 
By 1900 fairly effective numerical integration methods had been devised, but their 
implementation was severely restricted by the need to execute the computations by 
hand or with very primitive computing equipment. In the last 60 years the develop¬ 
ment of increasingly powerful and versatile computers has vastly enlarged the range 
of problems that can be investigated effectively by numerical methods. Extremely 
refined and robust numerical integrators were developed during the same period 
and are readily available. Versions appropriate for personal computers have brought 
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CHAPTER 


First Order 
Differential Equations 


This chapter deals with differential equations of first order 

§=/«.>•>. a* 

where / is a given function of two variables. Any differentiable function y = 0(t) that 
satisfies this equation for all t in some interval is called a solution, and our object is 
to determine whether such functions exist and, if so, to develop methods for finding 
them. Unfortunately, for an arbitrary function/, there is no general method for solv¬ 
ing the equation in terms of elementary functions. Instead, we will describe several 
methods, each of which is applicable to a certain subclass of first order equations. 
The most important of these are linear equations (Section 2.1), separable equa¬ 
tions (Section 2.2), and exact equations (Section 2.6). Other sections of this chapter 
describe some of the important applications of first order differential equations, intro¬ 
duce the idea of approximating a solution by numerical computation, and discuss 
some theoretical questions related to the existence and uniqueness of solutions. 
The final section includes an example of chaotic solutions in the context of first order 
difference equations, which have some important points of similarity with differential 
equations and are simpler to investigate. 


2.1 Linear Equations; Method of Integrating Factors 


If the function / in Eq. (1) depends linearly on the dependent variable y, then 
Eq. (1) is called a first order linear equation. In Sections 1.1 and 1.2 we discussed a 
restricted type of first order linear equation in which the coefficients are constants. 
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A typical example is 

^ = -ay + b, (2) 

where a and b are given constants. Recall that an equation of this form describes the 
motion of an object falling in the atmosphere. 

Now we want to consider the most general first order linear equation, which is 
obtained by replacing the coefficients a and b in Eq. (2) by arbitrary functions of t. 
We will usually write the general first order linear equation in the standard form 

^+p(t)y = g(t), (3) 

where p and g are given functions of the independent variable t. Sometimes it is more 
convenient to write the equation in the form 

P{t)% + Q(t)y = G{t), (4) 

at 

where P, Q , and G are given. Of course, as long as P(t) / 0, you can convert Eq. (4) 
to Eq. (3) by dividing Eq. (4) by P(t). 

In some cases it is possible to solve a first order linear equation immediately by 
integrating the equation, as in the next example. 


EXAMPLE 

1 


Solve the differential equation 

{4 + t 2 )^+2ty = 4t. (5) 

at 

The left side of Eq. (5) is a linear combination of dy/dt and y, a combination that also 
appears in the rule from calculus for differentiating a product. In fact, 

<4+ ' !) s +2 ^ = s l<4+ ' !,vl; 

it follows that Eq. (5) can be rewritten as 

^L[(4 + t 2 )y]=4t. (6) 

Thus, even though y is unknown, we can integrate both sides of Eq. (6) with respect to t, thereby 
obtaining 

(4 + t 2 )y = 2 1 2 + c, (7) 


where c is an arbitrary constant of integration. By solving for y we find that 

2 1 2 c 

y ~ 4 + t 2 + 4 +t 2 ' 

This is the general solution of Eq. (5). 


( 8 ) 


Unfortunately, most first order linear equations cannot be solved as illustrated in 
Example 1 because their left sides are not the derivative of the product of y and 
some other function. However, Leibniz discovered that if the differential equation is 
multiplied by a certain function p(t), then the equation is converted into one that is 
immediately integrable by using the product rule for derivatives, just as in Example 1. 
The function /i(t) is called an integrating factor and our main task is to determine 
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how to find it for a given equation. We will show how this method works first for an 
example and then for the general first order linear equation in the standard form (3). 


EXAMPLE 

2 


Find the general solution of the differential equation 


dy 

dt 


+ \y - b 


,1/3 


(9) 


Draw some representative integral curves; that is, plot solutions corresponding to several 
values of the arbitrary constant c. Also find the particular solution whose graph contains the 
point (0,1). 

The first step is to multiply Eq. (9) by a function /x(0, as yet undetermined; thus 


^~dt + = \^ e> 


H 3 


( 10 ) 


The question now is whether we can choose fi{t) so that the left side of Eq. (10) is the derivative 
of the product ti(t)y. For any differentiable function /x(0 we have 


d 

dt 


[/x(0y] = ^~dt + 


dii(t) 

dt 


-y> 


( 11 ) 


Thus the left side of Eq. (10) and the right side of Eq. (11) are identical, provided that we 
choose ji(i) to satisfy 


dfi(t) 

dt 




( 12 ) 


Our search for an integrating factor will be successful if we can find a solution of Eq. (12). 
Perhaps you can readily identify a function that satisfies Eq. (12): what well-known function 
from calculus has a derivative that is equal to one-half times the original function? More 
systematically, rewrite Eq. (12) as 

d/x(t)/dt 1 

m(0 2 ’ 


which is equivalent to 

Then it follows that 

In |/x(0l = \t + C, 


(13) 


or 


/i(t) = ce t!1 . 


(14) 


The function /i{t) given by Eq. (14) is an integrating factor for Eq. (9). Since we do not need 
the most general integrating factor, we will choose c to be 1 in Eq. (14) and use ji{t) = e t/2 . 
Now we return to Eq. (9), multiply it by the integrating factor e r/2 , and obtain 


t/2^l , 1 1/2 _ 1 5t/6 

dt +2 y ~ 2 ' 


(15) 


By the choice we have made of the integrating factor, the left side of Eq. (15) is the derivative 
of e t/2 y, so that Eq. (15) becomes 


d 

dt 


(e t/2 y) = \e 5t/6 . 


(16) 
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By integrating both sides of Eq. (16), we obtain 

e t/2 y = 3 e 5t/6 + ( 17 ) 

where c is an arbitrary constant. Finally, on solving Eq. (17) for y, we have the general solution 
of Eq. (9), namely, 

y = | e t/3 + ce~ t/2 . (18) 

To find the solution passing through the point (0,1), we set t = 0 and y = 1 in Eq. (18), 
obtaining 1 = (3/5) + c. Thus c = 2/5, and the desired solution is 

y = \e t/3 + \e~ tf2 . (19) 

Figure 2.1.1 includes the graphs of Eq. (18) for several values of c with a direction field in 
the background. The solution satisfying y(0) = 1 is shown by the black curve. 



? q 4 r r t 

z / /■/ / Z 3 / / 4 / / / 7 // 7 

/ // ////////////III 
/ /// /////////////III 

/y/ / // // // // // // III 
/////////////////// 

FIGURE 2.1.1 Direction field and integral curves of y' + \y — \e t/3 \ 
the black curve passes through the point (0,1). 


Let us now extend the method of integrating factors to equations of the form 

^ + ay = git), (20) 

where a is a given constant and g(t ) is a given function. Proceeding as in Example 2, 
we find that the integrating factor fi(t) must satisfy 


d/i 

dt 


= 


( 21 ) 


rather than Eq. (12). Thus the integrating factor is /i(t) = e at . Multiplying Eq. (20) 
by /x(0, we obtain 

,dy 


or 


^dt + ae “ ty = 


-ie at y) = e a, g(t). 


( 22 ) 
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By integrating both sides of Eq. (22), we find that 

e at y = J e at g(t) dt + c , (23) 

where c is an arbitrary constant. For many simple functions g(t), we can evaluate the 
integral in Eq. (23) and express the solution y in terms of elementary functions, as 
in Example 2. However, for more complicated functions g(t), it is necessary to leave 
the solution in integral form. In this case 

y = e~ at [ e as g(s ) ds + ce~ at . (24) 

Jto 

Note that in Eq. (24) we have used s to denote the integration variable to distinguish 
it from the independent variable t, and we have chosen some convenient value to as 
the lower limit of integration. 


Find the general solution of the differential equation 

EXAMPLE 

3 !-*--< <*> 

and plot the graphs of several solutions. Discuss the behavior of solutions as t oo. 

Equation (25) is of the form (20) with a = —2; therefore, the integrating factor is 
li(t) = e~ 2t . Multiplying the differential equation (25) by /z(0, we obtain 

e- 1<d l - 2e~ 2t y = 4e~ 2 ‘ - te~ 2 ‘, 
dt 

or 

4 (e~ 2 ‘y) = 4e~ 2 ' - te~ 2t . (26) 

dt 

Then, by integrating both sides of this equation, we have 

e~ 2t y = -2e~ 2t + \te~ 2t + \e~ 2t + c, 

where we have used integration by parts on the last term in Eq. (26). Thus the general solution 
of Eq. (25) is 

y = -l + lt + ce 21 . (27) 

A direction field and graphs of the solution (27) for several values of c are shown in Figure 
2.1.2. The behavior of the solution for large values of t is determined by the term ce 2t . If c ^ 0, 
then the solution grows exponentially large in magnitude, with the same sign as c itself. Thus 
the solutions diverge as t becomes large. The boundary between solutions that ultimately grow 
positively and those that ultimately grow negatively occurs when c = 0. If we substitute c = 0 
into Eq. (27) and then set t = 0, we find that y = — 7/4 is the separation point on the y-axis. 
Note that for this initial value, the solution is y = — \ + \t\ it grows positively, but linearly 
rather than exponentially. 
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FIGURE 2.1.2 Direction field and integral curves of y' — 2y = 4 — t. 


Now we return to the general first order linear equation (3) 

dy 

— + p(t)y = g(t ), 

where p and g are given functions. To determine an appropriate integrating factor, 
we multiply Eq. (3) by an as yet undetermined function p(t), obtaining 

m(0“77 +P (OlMt)y = ix ( t)g(t ). (28) 

dt 

Following the same line of development as in Example 2, we see that the left side 
of Eq. (28) is the derivative of the product p(t)y, provided that p(t) satisfies the 
equation 

=p(t)li(t). (29) 

If we assume temporarily that p(t) is positive, then we have 


dp(t)/dt 


= P(t), 


and consequently 


In pit) 


/ 


p(t) dt + k. 


By choosing the arbitrary constant k to be zero, we obtain the simplest possible 
function for /x, namely, 

p(t) = exp / p(t)dt. (30) 


Note that p{t) is positive for all t , as we assumed. Returning to Eq. (28), we have 


d 

dt 


[p{t)y] = p(t)g(t). 


(31) 
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Hence 

n(t)y = J M(0g(0 dt + c, (32) 

where c is an arbitrary constant. Sometimes the integral in Eq.(32) can be evaluated 
in terms of elementary functions. However, in general this is not possible, so the 
general solution of Eq. (3) is 


1 

fi(t) 


f 

J tn 


fi(s)g(s) ds + c 


(33) 


where again to is some convenient lower limit of integration. Observe that Eq. (33) 
involves two integrations, one to obtain /i(t) from Eq. (30) and the other to determine 
y from Eq. (33). 


EXAMPLE 

4 


Solve the initial value problem 


ty' + 2y = 41 2 , 

y( 1 ) = 2 . 


(34) 

(35) 


In order to determine p(t) and g(t) correctly, we must first rewrite Eq. (34) in the standard 
form (3). Thus we have 

/ + (2 /t)y = 41, (36) 

so p(t) = lit and g(t) = 4 1 . To solve Eq. (36), we first compute the integrating factor /n(t): 

li(t) = exp J y dt = e 2ln{tl = t 2 . 

On multiplying Eq. (36) by p{t) = t 2 , we obtain 

t 2 y' + 2 ty = ( t 2 y)' = 41 3 , 


and therefore 

t 2 y = t 4 + c, 

where c is an arbitrary constant. It follows that 

y = + ( 37 ) 

is the general solution of Eq. (34). Integral curves of Eq. (34) for several values of c are shown 
in Figure 2.1.3. To satisfy the initial condition (35), it is necessary to choose c = 1; thus 

y = t 2 + t > 0 (38) 

is the solution of the initial value problem (34), (35). This solution is shown by the black curve 
in Figure 2.1.3. Note that it becomes unbounded and is asymptotic to the positive y-axis as 
t 0 from the right. This is the effect of the infinite discontinuity in the coefficient p(t) at 
the origin. The function y = t 2 + (1/E) for t < 0 is not part of the solution of this initial value 
problem. 

This is the first example in which the solution fails to exist for some values of t. Again, this 
is due to the infinite discontinuity in pit) at t = 0, which restricts the solution to the interval 

0 < t < oo. 

Looking again at Figure 2.1.3, we see that some solutions (those for which c > 0) are asymp¬ 
totic to the positive y-axis as t —► 0 from the right, while other solutions (for which c < o) 
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are asymptotic to the negative y-axis. The solution for which c = 0, namely, y = t 2 , remains 
bounded and differentiable even at t = 0. If we generalize the initial condition (35) to 

y( 1) = yo, (39) 

then c = y 0 — 1 and the solution (38) becomes 

y - t 2 + y ° f2 1 , f > 0 if y 0 ^ 1. (40) 

As in Example 3, this is another instance where there is a critical initial value, namely, y 0 = 1, 
that separates solutions that behave in one way from others that behave quite differently. 



FIGURE 2.1.3 Integral curves of the differential equation ty' + 2 y = 41 2 \ 
the black curve passes through the point (1,2). 


Solve the initial value problem 

EXAMPLE 

g 2/ + ty = 2, (41) 

y(0) = 1. (42) 

To convert the differential equation (41) to the standard form (3), we must divide by 2, 
obtaining 

/ + (t/2)y = 1. (43) 

Thus p{t ) = t/ 2, and the integrating factor is /z(0 = exp(t 2 /4). Then multiply Eq. (43) by /x(t), 
so that 

e* 2/4 y' + ^e ?2/4 y = e t2/A . (44) 

The left side of Eq. (44) is the derivative of e t2/4 y, so by integrating both sides of Eq. (44), we 
obtain 




( 45 ) 
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PROBLEMS 


The integral on the right side of Eq. (45) cannot be evaluated in terms of the usual elementary 
functions, so we leave the integral unevaluated. However, by choosing the lower limit of 
integration as the initial point t = 0, we can replace Eq. (45) by 

e t 2 / 4 y= fef^ds + c, (46) 

Jo 

where c is an arbitrary constant. It then follows that the general solution y of Eq. (41) is 
given by 

y = e~ t2/A f e s2/4 ds + ce~ t2/A . (47) 

Jo 

The initial condition (42) requires that c = 1. 

The main purpose of this example is to illustrate that sometimes the solution must be left in 
terms of an integral. This is usually at most a slight inconvenience, rather than a serious obstacle. 
For a given value of t, the integral in Eq. (47) is a definite integral and can be approximated to 
any desired degree of accuracy by using readily available numerical integrators. By repeating 
this process for many values of t and plotting the results, you can obtain a graph of a solution. 
Alternatively, you can use a numerical approximation method, such as those discussed in 
Chapter 8, that proceed directly from the differential equation and need no expression for the 
solution. Software packages such as Maple and Mathematica readily execute such procedures 
and produce graphs of solutions of differential equations. 

Figure 2.1.4 displays graphs of the solution (47) for several values of c. From the figure it 
may be plausible to conjecture that all solutions approach a limit as t oo. The limit can be 
found analytically (see Problem 32). 



In each of Problems 1 through 12: 

(a) Draw a direction field for the given differential equation. 

(b) Based on an inspection of the direction field, describe how solutions behave for large t. 

(c) Find the general solution of the given differential equation, and use it to determine how 
solutions behave as t -> oo. 
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01 

1. 

y' + 3y-- 

= t + e 2t 

01 

2. 

II 

<b 

1 

X 

: t 2 e 2t 


01 

3. 

y'+y = 

te~ l +1 

01 

4. 

y + (1 /t)y = 3 cos 2 1, 

01 

5. 

y'-2y-- 

= 3d 

01 

6. 

+ 

n 

= sin t, 

t > 0 

01 

7. 

y + 2 ty 

= 2 te~ t2 

01 

8. 

(1 + t 2 )y’ 

II 

'x|- 

+ 

(1 + t 2 ) 

01 

9. 

2 y' + y-- 

= 31 

01 

10. 

II 

1 

t 2 e 1 , 

t > 0 

01 

11. 

II 

+ 

5 sin 2 1 

01 

12. 

2 y' + y = 

:3 1 2 



In each of Problems 13 through 20, find the solution of the given initial value problem. 

13. y' — y = 2te 2t , y(0) = 1 

14. y' + 2y = te~ 2t , y( 1) = 0 

15. ty' + 2y = t 2 — t + 1, y(l) = |, t > 0 

16. / + (2/t)y = (cos t)/t 2 , y{n) = 0, t > 0 

17. y' — 2y — e 2t , y(0) = 2 

18. + 2y = sint, y(?z/2) = 1, t > 0 

19. t 3 y + 4t 2 y = y(—1) = 0, t < 0 

20. ty 1 + (t + l)y = t, y(ln2) = 1, t > 0 

In each of Problems 21 through 23: 

(a) Draw a direction field for the given differential equation. How do solutions appear to 
behave as t becomes large? Does the behavior depend on the choice of the initial value at 
Let a 0 be the value of a for which the transition from one type of behavior to another occurs. 
Estimate the value of a 0 . 

(b) Solve the initial value problem and find the critical value a 0 exactly. 

(c) Describe the behavior of the solution corresponding to the initial value a 0 . 

21. y — \y = 2cost, y(0) = a 
01 22. 2y'-y = e t l\ y(0) = a 

23. 3/ -2 y = e~ M/2 , y(0) = a 

In each of Problems 24 through 26: 

(a) Draw a direction field for the given differential equation. How do solutions appear to 
behave as t 0? Does the behavior depend on the choice of the initial value at Let a 0 be the 
value of a for which the transition from one type of behavior to another occurs. Estimate the 
value of ao. 

(b) Solve the initial value problem and find the critical value ao exactly. 

(c) Describe the behavior of the solution corresponding to the initial value ao. 

24. ty' + (t 4-1 )y = 2 te~\ y( 1) = a, t > 0 

25. ty' + 2 y = (sin t)/t, y(—7r/2) = a, t < 0 

26. (sint)y + (cos t)y = e\ y(l) = a, 0 < t < jt 

27. Consider the initial value problem 

y + |y = 2cost, y(0) = —1. 

Find the coordinates of the first local maximum point of the solution for t > 0. 

01 28. Consider the initial value problem 

y'+ly = l-\t, y(Q)=y a . 


Find the value of y 0 for which the solution touches, but does not cross, the t-axis. 
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29. Consider the initial value problem 

y' + \y = 3 + 2cos2t, y(0) = 0. 

(a) Find the solution of this initial value problem and describe its behavior for large t. 

(b) Determine the value of t for which the solution first intersects the line y = 12. 

30. Find the value of y 0 for which the solution of the initial value problem 

/ - y = 1 + 3 sin t, y (0) = y 0 


remains finite as t oo. 

31. Consider the initial value problem 

/ - \y = 3t + 2e‘, y( 0) = y 0 . 

Find the value of y 0 that separates solutions that grow positively as t oo from those 
that grow negatively. How does the solution that corresponds to this critical value of yo 
behave as t -> oo? 

32. Show that all solutions of 2 y' + ty = 2 [Eq. (41) of the text] approach a limit as t oo, 
and find the limiting value. 

Hint: Consider the general solution, Eq. (47), and use L’Hopital’s rule on the first term. 

33. Show that if a and 7 are positive constants, and b is any real number, then every solution 
of the equation 

y' + ay = be~ u 

has the property that y -> 0 as t oo. 

Hint: Consider the cases a = X and a/A separately. 

In each of Problems 34 through 37, construct a first order linear differential equation whose 
solutions have the required behavior as t -> oo. Then solve your equation and confirm that 
the solutions do indeed have the specified property. 

34. All solutions have the limit 3 as t oo. 

35. All solutions are asymptotic to the line y = 3 — t as t ^ oo. 

36. All solutions are asymptotic to the line y = 2t — 5 as t oo. 

37. All solutions approach the curve y = 4 — t 2 as t oo. 

38. Variation of Parameters. Consider the following method of solving the general linear 
equation of first order: 

y'+p(t)y = g(t). (i) 


(a) If g(t) = 0 for all t , show that the solution is 


y = A exp 



p(t) dt 


(ii) 


where A is a constant. 

(b) If g(t) is not everywhere zero, assume that the solution of Eq. (i) is of the form 

y = A(t) exp 


[-/ 


- / p(f) dt 


(iii) 
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where A is now a function of t. By substituting for y in the given differential equation, 
show ihdXA{t) must satisfy the condition 


A\t) =g(t ) exp 



(iv) 


(c) Find A(t) from Eq. (iv). Then substitute for A{t) in Eq. (iii) and determine y. Verify 
that the solution obtained in this manner agrees with that of Eq. (33) in the text. This 
technique is known as the method of variation of parameters; it is discussed in detail in 
Section 3.6 in connection with second order linear equations. 


In each of Problems 39 through 42, use the method of Problem 38 to solve the given differential 
equation. 

39. y-2y = t 2 e 2t 40. y' + (1 /t)y = 3 cos 2 1, t > 0 

41. ty' + 2y = sin t, t > 0 42. 2/ + y = 3 1 2 


2.2 Separable Equations 


In Section 1.2 we used a process of direct integration to solve first order linear 
equations of the form 

t =ay+b - (i> 

where a and b are constants. We will now show that this process is actually applicable 
to a much larger class of equations. 

We will use x, rather than t , to denote the independent variable in this section for 
two reasons. In the first place, different letters are frequently used for the variables in 
a differential equation, and you should not become too accustomed to using a single 
pair. In particular, x often occurs as the independent variable. Further, we want to 
reserve t for another purpose later in the section. 

The general first order equation is 

t= f<x ' y) - <2> 

Linear equations were considered in the preceding section, but if Eq. (2) is nonlinear, 
then there is no universally applicable method for solving the equation. Here, we 
consider a subclass of first order equations that can be solved by direct integration. 
To identify this class of equations, we first rewrite Eq. (2) in the form 

dy 

M{x,y) + N(x,y)-j- = 0. (3) 

dx 

It is always possible to do this by setting M(x,y) = —f(x,y) andA/^(x,y) = 1, but there 
may be other ways as well. If it happens that M is a function of x only and N is a 
function of y only, then Eq. (3) becomes 
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Such an equation is said to be separable, because if it is written in the differential 
form 


M(x) dx + N(y) dy = 0, (5) 

then, if you wish, terms involving each variable may be placed on opposite sides 
of the equation. The differential form (5) is also more symmetric and tends to 
suppress the distinction between independent and dependent variables. 

A separable equation can be solved by integrating the functions M and N. 
We illustrate the process by an example and then discuss it in general for Eq. (4). 


Show that the equation 

EXAMPLE 

1 


dy x 2 

dx 1 — y 2 


is separable, and then find an equation for its integral curves. 
If we write Eq. (6) as 


-x 2 + (1 




( 6 ) 


(7) 


then it has the form (4) and is therefore separable. Recall from calculus that if y is a function 
of x, then by the chain rule, 




dy 

dx 


=f(y ) 


dy 

dx 


For example, if f(y) = y — y 3 / 3, then 


10.-//3) _(!-/) 


dy 

dx 


Thus the second term in Eq. (7) is the derivative with respect to x of y — y 3 /3, and the first 
term is the derivative of —x 3 /3. Thus Eq. (7) can be written as 



Therefore, by integrating, we obtain 


-x 3 +3 y - y 3 = c, (8) 

where c is an arbitrary constant. Equation (8) is an equation for the integral curves of Eq. (6). 
A direction field and several integral curves are shown in Figure 2.2.1. Any differentiable 
function y = 0(x) that satisfies Eq. (8) is a solution of Eq. (6). An equation of the integral 
curve passing through a particular point (xo,yo) can be found by substituting xo and yo for x 
and y, respectively, in Eq. (8) and determining the corresponding value of c. 
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FIGURE 2.2.1 Direction field and integral curves of y' — x 2 /(l — y 2 ). 


Essentially the same procedure can be followed for any separable equation. 
Returning to Eq. (4), let Hi and H 2 be any antiderivatives of M and N, respectively. 
Thus 

H[(x)=M(x ), H f 2 (y)=N(y ), (9) 


and Eq. (4) becomes 


H[(x) + Hyy)^=0. 


If y is regarded as a function of x, then according to the chain rule, 

, dy d dy d 

H ^i = Ty H ^i = T x H ^- 

Consequently, we can write Eq. (10) as 


— \H 1 (x)+H 2 (y)] = 0. 
dx 


By integrating Eq. (12), we obtain 


( 10 ) 


( 11 ) 


( 12 ) 


Hiix) + H 2 (y) = c, 


(13) 


where c is an arbitrary constant. Any differentiable function y = (p(x) that satisfies 
Eq. (13) is a solution of Eq. (4); in other words, Eq. (13) defines the solution implic¬ 
itly rather than explicitly. In practice, Eq. (13) is usually obtained from Eq. (5) by 
integrating the first term with respect to x and the second term with respect to y. The 
justification for this is the argument that we have just given. 

The differential equation (4), together with an initial condition 


yCxo) = y o, 


( 14 ) 
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forms an initial value problem. To solve this initial value problem, we must determine 
the appropriate value for the constant c in Eq. (13). We do this by setting x = xo and 
y = yo in Eq. (13) with the result that 

c = H^xq) + H 2 (yo). (15) 


Substituting this value of c in Eq. (13) and noting that 


Hiix) - Hi (x 0 ) 


-f 

Jxo 


M{s)ds, H 2 (y) - H 2 (yo) 


-f 

J y o 


N(s) ds , 


we obtain 


[ M(s) ds + f N(s ) ds = 0. 

Jx o Jyo 


(16) 


Equation (16) is an implicit representation of the solution of the differential equation 
(4) that also satisfies the initial condition (14). Bear in mind that to determine an 
explicit formula for the solution, you need to solve Eq. (16) for y as a function of x. 
Unfortunately, it is often impossible to do this analytically; in such cases you can 
resort to numerical methods to find approximate values of y for given values of x. 


EXAMPLE 

2 


Solve the initial value problem 

dy 3x 2 + 4x + 2 


y(0) = - 1 , 


dx 2(y - 1) 

and determine the interval in which the solution exists. 

The differential equation can be written as 

2 (y — 1) dy = (3x 2 + 4x + 2) dx. 

Integrating the left side with respect to y and the right side with respect to x gives 

y 1 — 2y = x 3 + 2x 2 + 2x + c, 


(17) 


(18) 


where c is an arbitrary constant. To determine the solution satisfying the prescribed initial 
condition, we substitute x = 0 and y = — 1 in Eq. (18), obtaining c = 3. Hence the solution of 
the initial value problem is given implicitly by 

y 2 - 2y = x 3 + 2x 2 + 2x + 3. (19) 

To obtain the solution explicitly, we must solve Eq. (19) for y in terms of x. That is a simple 
matter in this case, since Eq. (19) is quadratic in y, and we obtain 

y = 1 ± Vx 3 + 2x 2 + 2x + 4. (20) 

Equation (20) gives two solutions of the differential equation, only one of which, however, 
satisfies the given initial condition. This is the solution corresponding to the minus sign in 
Eq. (20), so we finally obtain 

y = 0(x) = 1 — \/x 3 ~b 2x 2 ~b 2x -1- 4 (31) 

as the solution of the initial value problem (17). Note that if we choose the plus sign by mistake 
in Eq. (20), then we obtain the solution of the same differential equation that satisfies the initial 
condition y(0) = 3. Finally, to determine the interval in which the solution (21) is valid, we must 
find the interval in which the quantity under the radical is positive. The only real zero of this 
expression is x = —2, so the desired interval is x > —2. Some integral curves of the differential 
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EXAMPLE 

3 


equation are shown in Figure 2.2.2. The black curve passes through the point (0, —1) and thus 
is the solution of the initial value problem (17). Observe that the boundary of the interval 
of validity of the solution (21) is determined by the point (—2,1) at which the tangent line is 
vertical. 



FIGURE 2.2.2 Integral curves of y' — (3x 2 + 4x + 2) /2(y - 1); the 
solution satisfying y (0) = —1 is shown in black and is valid for x > —2. 


Solve the equation 


dy 4x — x 3 
dx = 4 + y 3 


( 22 ) 


and draw graphs of several integral curves. Also find the solution passing through the point 
(0,1) and determine its interval of validity. 

Rewriting Eq. (22) as 

(4 + y 3 ) dy = (4x — x 3 ) dx, 


integrating each side, multiplying by 4, and rearranging the terms, we obtain 

y 4 + 16y + x 4 — 8x 2 = c, (23) 

where c is an arbitrary constant. Any differentiable function y = (p(x) that satisfies Eq. (23) 
is a solution of the differential equation (22). Graphs of Eq. (23) for several values of c are 
shown in Figure 2.2.3. 

To find the particular solution passing through (0,1), we set x = 0 and y = 1 in Eq. (23) with 
the result that c = 17. Thus the solution in question is given implicitly by 

y 4 + 16y 4- x 4 — 8x 2 = 17. (24) 


It is shown by the black curve in Figure 2.2.3. The interval of validity of this solution extends 
on either side of the initial point as long as the function remains differentiable. From the 
figure we see that the interval ends when we reach points where the tangent line is verti¬ 
cal. It follows from the differential equation (22) that these are points where 4 + y 3 = 0, or 
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FIGURE 2.2.3 Integral curves of y' = (4x — x 3 )/(4 ± y 3 ). 
The solution passing through (0,1) is shown by the black curve. 


y = (-4) 1/3 = -1.5874. From Eq. (24) the corresponding values of x are x = ±3.3488. These 
points are marked on the graph in Figure 2.2.3. 


Note 1: Sometimes an equation of the form (2) 


dy 

dx 


f(x,y) 


has a constant solution y = yo- Such a solution is usually easy to find because if 
f(x,yo) = 0 for some value yo and for all x, then the constant function y = y 0 is a 
solution of the differential equation (2). For example, the equation 


dy (y — 3) cos x 
dx 1 + 2y 2 


has the constant solution y = 3. Other solutions of this equation can be found by 
separating the variables and integrating. 

Note 2: The investigation of a first order nonlinear equation can sometimes be 
facilitated by regarding both x and y as functions of a third variable t. Then 

& = f * 11 *. (26) 

dx dx/dt 


If the differential equation is 


dy F(x,y) 











48 


Chapter 2 . First Order Differential Equations 


then, by comparing numerators and denominators in Eqs. (26) and (27), we obtain 
the system 

dx/dt = G(x,y), dy/dt = F(x,y). (28) 

At first sight it may seem unlikely that a problem will be simplified by replacing a 
single equation by a pair of equations, but in fact, the system (28) may well be more 
amenable to investigation than the single equation (27). Chapter 9 is devoted to 
nonlinear systems of the form (28). 

Note 3: In Example 2 it was not difficult to solve explicitly for y as a function 
of x. However, this situation is exceptional, and often it will be better to leave the 
solution in implicit form, as in Examples 1 and 3. Thus, in the problems below and 
in other sections where nonlinear equations appear, the words “solve the following 
differential equation” mean to find the solution explicitly if it is convenient to do so, 
but otherwise to find an equation defining the solution implicitly. 


PROBLEMS In each of Problems 1 through 8, solve the given differential equation. 

1. y = x 2 /y 2. y — x 2 /y(l + x 3 ) 

3. y + y 2 sinx = 0 4. y' = (3x 2 — l)/(3 + 2 y) 

5. y — (cos 2 x) (cos 2 2y) 6. xy' — (1 — y 2 ) 1/2 

^ dy x — e~ x g dy x 2 


dx y + ey dx 1 + y 2 

In each of Problems 9 through 20: 

(a) Find the solution of the given initial value problem in explicit form. 

(b) Plot the graph of the solution. 

(c) Determine (at least approximately) the interval in which the solution is defined. 


41 

9. 

i 

II 

y(0) = - 

-1/6 

41 io- / 

= (1- 

■ 2 x)/y, y( 1) = -2 

41 

11. 

xdx-\- ye~ x dy = 0, 

y( 0) = 

= 1 

12. dr/d6 = 

r 2 /0, r{ 1) = 2 

41 

13. 

y' = 2 x/(y + x 2 y), 

y(0) = 

= -2 

41 14. / 

= xy 3 (l +x 2 ) 1/2 , y(0) = 1 

41 

15. 

y' = 2x/(l + 2 y). 

y( 2) = 

0 

16 . y 

= x(x 2 

+ l)/4/, y(0) = -1/V2 

41 

17. 

y' = (3x 2 - e x )/(2y - 

-5), 

y( 0) 

= l 



41 

18. 

X. 

II 

i 

x 

1 

+ 

4 y), 

y(0) 

= l 



41 

19. 

sin 2x dx + cos 3y dy 

= 0, 

y{n/2) = tt/3 



41 

20. 

y 2 ( 1 — x 2 ) 1/2 dy = arcsin xdx. 

> 

v(0j = 1 




Some of the results requested in Problems 21 through 28 can be obtained either by solving 
the given equations analytically or by plotting numerically generated approximations to the 
solutions. Try to form an opinion about the advantages and disadvantages of each approach. 
21. Solve the initial value problem 


/ = (1 + 3x 2 )/(3/ - 6y), y(0) = 1 


and determine the interval in which the solution is valid. 

Hint: To find the interval of definition, look for points where the integral curve has a 
vertical tangent. 
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41 22. Solve the initial value problem 

/ = 3x 2 /(3y 2 - 4), y(l) = 0 
and determine the interval in which the solution is valid. 

Hint: To find the interval of definition, look for points where the integral curve has a 
vertical tangent. 

41 23. Solve the initial value problem 

y' = 2y 2 +xy 2 , y(0) = 1 

and determine where the solution attains its minimum value. 

24. Solve the initial value problem 

/ = ( 2-e x )/(3 + 2y), y( 0) = 0 

and determine where the solution attains its maximum value. 

25. Solve the initial value problem 

/ = 2cos2x/(3 + 2y), y(0) = — 1 

and determine where the solution attains its maximum value. 

41 26. Solve the initial value problem 

y' = 2a+x)(l+y 2 ), y( 0 ) = 0 

and determine where the solution attains its minimum value. 

27. Consider the initial value problem 

/ = ty(4-y)/3, y( 0) = y 0 . 

(a) Determine how the behavior of the solution as t increases depends on the initial 
value y 0 . 

(b) Suppose thatyo = 0.5. Find the time T at which the solution first reaches the value 3.98. 
41 28. Consider the initial value problem 

/ = ty(4 - y)/( 1 + t), y( 0) = y 0 > 0. 

(a) Determine how the solution behaves as t -> oo. 

(b) If y 0 = 2, find the time T at which the solution first reaches the value 3.99. 

(c) Find the range of initial values for which the solution lies in the interval 3.99 < y < 4.01 
by the time t = 2. 

29. Solve the equation 

dy ay + b 

dx cy + d ’ 


where a , b , c, and d are constants. 

Homogeneous Equations. If the right side of the equation dy/dx=f(x,y) can 
be expressed as a function of the ratio y/x only, then the equation is said to be 
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homogeneous. 1 Such equations can always be transformed into separable equations 
by a change of the dependent variable. Problem 30 illustrates how to solve first order 
homogeneous equations. 

30. Consider the equation 


dy y — 4x 
dx x — y ' 


(i) 


(a) Show that Eq. (i) can be rewritten as 


dy _ (y/x) — 4 
dx 1 — (y/x) ’ 


(ii) 


thus Eq. (i) is homogeneous. 

(b) Introduce a new dependent variable v so that v = y/x , or y = xv(x). Express dy/dx in 
terms of x, v, and dv/dx. 

(c) Replace y and dy/dx in Eq. (ii) by the expressions from part (b) that involve v and 
dv/dx. Show that the resulting differential equation is 

dv v — 4 
v + x— = --, 


or 


dv v 2 - 4 
dx 1 — v 


(iii) 


Observe that Eq. (iii) is separable. 

(d) Solve Eq. (iii), obtaining v implicitly in terms of x. 

(e) Find the solution of Eq. (i) by replacing v by y/x in the solution in part (d). 

(f) Draw a direction field and some integral curves for Eq. (i). Recall that the right side 
of Eq. (i) actually depends only on the ratio y/x. This means that integral curves have 
the same slope at all points on any given straight line through the origin, although the 
slope changes from one line to another. Therefore, the direction field and the integral 
curves are symmetric with respect to the origin. Is this symmetry property evident from 
your plot? 


4fl 31. 
4fl 33 . 


The method outlined in Problem 30 can be used for any homogeneous equation. That 
is, the substitution y = xv(x) transforms a homogeneous equation into a separable 
equation. The latter equation can be solved by direct integration, and then replacing v 
by y/x gives the solution to the original equation. In each of Problems 31 through 38: 

(a) Show that the given equation is homogeneous. 

(b) Solve the differential equation. 

(c) Draw a direction field and some integral curves. Are they symmetric with respect to 
the origin? 


x 2 + xy + y 2 


dy 

dx x 2 

dy 4 y — 3x 
dx 2x — y 




dy x 2 + 3y 2 


41 34 . 


dy 

dx 


2 xy 

4x + 3 y 
2 x 4-y 


lr The word “homogeneous” has different meanings in different mathematical contexts. The homogeneous 
equations considered here have nothing to do with the homogeneous equations that will occur in Chapter 3 
and elsewhere. 












2.3 Modeling with First Order Equations 


51 


41 35. 
41 37. 


dy x + 3 y 
dx x — y 

41 36. 

dy x 2 - 3 y 1 

dx 2 xy 

41 38. 


(x 2 + 3xy +y 2 )dx 

dy _ 3/ - x 2 
dx 2xy 


x 2 dy = 0 


2.3 Modeling with First Order Equations 


Differential equations are of interest to nonmathematicians primarily because of the 
possibility of using them to investigate a wide variety of problems in the physical, 
biological, and social sciences. One reason for this is that mathematical models and 
their solutions lead to equations relating the variables and parameters in the prob¬ 
lem. These equations often enable you to make predictions about how the natural 
process will behave in various circumstances. It is often easy to vary parameters in 
the mathematical model over wide ranges, whereas this may be very time-consuming 
or expensive, if not impossible, in an experimental setting. Nevertheless, mathemat¬ 
ical modeling and experiment or observation are both critically important and have 
somewhat complementary roles in scientific investigations. Mathematical models are 
validated by comparison of their predictions with experimental results. On the other 
hand, mathematical analyses may suggest the most promising directions to explore 
experimentally, and they may indicate fairly precisely what experimental data will 
be most helpful. 

In Sections 1.1 and 1.2 we formulated and investigated a few simple mathemat¬ 
ical models. We begin by recapitulating and expanding on some of the conclusions 
reached in those sections. Regardless of the specific field of application, there are 
three identifiable steps that are always present in the process of mathematical 
modeling. 

Construction of the Model. In this step you translate the physical situation into math¬ 
ematical terms, often using the steps listed at the end of Section 1.1. Perhaps most 
critical at this stage is to state clearly the physical principle(s) that are believed to 
govern the process. For example, it has been observed that in some circumstances 
heat passes from a warmer to a cooler body at a rate proportional to the temperature 
difference, that objects move about in accordance with Newton’s laws of motion, and 
that isolated insect populations grow at a rate proportional to the current population. 
Each of these statements involves a rate of change (derivative) and consequently, 
when expressed mathematically, leads to a differential equation. The differential 
equation is a mathematical model of the process. 

It is important to realize that the mathematical equations are almost always only 
an approximate description of the actual process. For example, bodies moving at 
speeds comparable to the speed of light are not governed by Newton’s laws, insect 
populations do not grow indefinitely as stated because of eventual lack of food or 
space, and heat transfer is affected by factors other than the temperature difference. 
Thus you should always be aware of the limitations of the model so that you will use 
it only when it is reasonable to believe that it is accurate. Alternatively, you can adopt 
the point of view that the mathematical equations exactly describe the operation of 
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EXAMPLE 

1 


Mixing 


a simplified physical model, which has been constructed (or conceived of) so as to 
embody the most important features of the actual process. Sometimes, the process 
of mathematical modeling involves the conceptual replacement of a discrete process 
by a continuous one. For instance, the number of members in an insect population 
changes by discrete amounts; however, if the population is large, it seems reasonable 
to consider it as a continuous variable and even to speak of its derivative. 

Analysis of the Model. Once the problem has been formulated mathematically, you are 
often faced with the problem of solving one or more differential equations or, failing 
that, of finding out as much as possible about the properties of the solution. It may 
happen that this mathematical problem is quite difficult, and if so, further approxima¬ 
tions may be indicated at this stage to make the problem mathematically tractable. 
For example, a nonlinear equation may be approximated by a linear one, or a slowly 
varying coefficient may be replaced by a constant. Naturally, any such approxima¬ 
tions must also be examined from the physical point of view to make sure that the 
simplified mathematical problem still reflects the essential features of the physical 
process under investigation. At the same time, an intimate knowledge of the physics 
of the problem may suggest reasonable mathematical approximations that will make 
the mathematical problem more amenable to analysis. This interplay of understand¬ 
ing of physical phenomena and knowledge of mathematical techniques and their 
limitations is characteristic of applied mathematics at its best, and it is indispens¬ 
able in successfully constructing useful mathematical models of intricate physical 
processes. 

Comparison with Experiment or Observation. Finally, having obtained the solution (or at 
least some information about it), you must interpret this information in the con¬ 
text in which the problem arose. In particular, you should always check that the 
mathematical solution appears physically reasonable. If possible, calculate the values 
of the solution at selected points and compare them with experimentally observed 
values. Or ask whether the behavior of the solution after a long time is consistent 
with observations. Or examine the solutions corresponding to certain special values of 
parameters in the problem. Of course, the fact that the mathematical solution appears 
to be reasonable does not guarantee that it is correct. However, if the predictions of 
the mathematical model are seriously inconsistent with observations of the physical 
system it purports to describe, this suggests that errors have been made in solving 
the mathematical problem, that the mathematical model itself needs refinement, or 
that observations must be made with greater care. 

The examples in this section are typical of applications in which first order differ¬ 
ential equations arise. 

At time t = 0 a tank contains go lb of salt dissolved in 100 gal of water; see Figure 2.3.1. Assume 
that water containing J lb of salt/gal is entering the tank at a rate of r gal/min and that the 
well-stirred mixture is draining from the tank at the same rate. Set up the initial value problem 
that describes this flow process. Find the amount of salt Q(t) in the tank at any time, and also 
find the limiting amount Q L that is present after a very long time. If r = 3 and Qo = 2Q L , find 
the time T after which the salt level is within 2% of Ql. Also find the flow rate that is required 
if the value of T is not to exceed 45 min. 

We assume that salt is neither created nor destroyed in the tank. Therefore, variations in 
the amount of salt are due solely to the flows in and out of the tank. More precisely, the rate 
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of change of salt in the tank, dQ/dt , is equal to the rate at which salt is flowing in minus the 
rate at which it is flowing out. In symbols, 


—— = rate in — rate out. 
dt 


(i) 


The rate at which salt enters the tank is the concentration | lb/gal times the flow rate r gal/min, 
or (r/4) lb/min. To find the rate at which salt leaves the tank, we need to multiply the concen¬ 
tration of salt in the tank by the rate of outflow, r gal/min. Since the rates of flow in and out 
are equal, the volume of water in the tank remains constant at 100 gal, and since the mixture 
is “well-stirred,” the concentration throughout the tank is the same, namely, [<2(0/100] lb/gal. 
Therefore, the rate at which salt leaves the tank is [r<2(0/100] lb/min. Thus the differential 
equation governing this process is 


dQ _ r rQ 
~dt ~ 4 ~ 100' 


( 2 ) 


The initial condition is 

<2(0) = Go- (3) 


rgal/min, \ Ib/gal 



FIGURE 2.3.1 The water tank in Example 1. 


Upon thinking about the problem physically, we might anticipate that eventually the mixture 
originally in the tank will be essentially replaced by the mixture flowing in, whose concentration 
is J lb/gal. Consequently, we might expect that ultimately the amount of salt in the tank would 
be very close to 25 lb. We can also find the limiting amount Q L = 25 by setting dQ/dt equal 
to zero in Eq. (2) and solving the resulting algebraic equation for Q. 

To solve the initial value problem (2), (3) analytically, note that Eq. (2) is both linear and 
separable. Rewriting it in the standard form for a linear equation, we have 


dQ rQ _ r 
dt + 100 “ 4' 


(4) 


Thus the integrating factor is e rt/10 ° and the general solution is 


Q(t) = 25 + ce _rt/10 °, 


(5) 


wherecis an arbitrary constant. Tosatisfythe initial condition (3),we must choosec = Q 0 — 25. 
Therefore, the solution of the initial value problem (2), (3) is 

-rf/100 


Q(t) = 25 + (Q 0 - 25)e' 


( 6 ) 
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or 

Q(t ) = 25(1 - e ~ rt/m ) + Q 0 e~ rt/10 °. (7) 

From Eq. (6) or (7), you can see that Q(t ) 25 (lb) as t oo, so the limiting value Q L is 
25, confirming our physical intuition. Further, Q(t) approaches the limit more rapidly as r 
increases. In interpreting the solution (7), note that the second term on the right side is the 
portion of the original salt that remains at time t , while the first term gives the amount of salt in 
the tank as a consequence of the flow processes. Plots of the solution for r = 3 and for several 
values of Qo are shown in Figure 2.3.2. 



FIGURE 2.3.2 Solutions of the initial value problem (2), (3): 
dQ/dt = (r/4) — r<2/100, Q(0) = Qo for r = 3 and several values of go- 


Now suppose that r = 3 and Qo = 2 Q L = 50; then Eq. (6) becomes 

<2(0 = 25 + 25e~°' 03t . (8) 

Since 2% of 25 is 0.5, we wish to find the time T at which Q(t) has the value 25.5. Substituting 
t=T and Q = 25.5 in Eq. (8) and solving for T, we obtain 

T = (In50)/0.03 = 130.4 (min). (9) 

To determine r so that T = 45, return to Eq. (6), set t = 45, Qo = 50, Q(t) = 25.5, and solve 
for r. The result is 

r = (100/45) In 50 = 8.69 gal/min. (10) 

Since this example is hypothetical, the validity of the model is not in question. If the flow 
rates are as stated, and if the concentration of salt in the tank is uniform, then the differential 
equation (1) is an accurate description of the flow process. Although this particular example 
has no special significance, models of this kind are often used in problems involving a pollutant 
in a lake, or a drug in an organ of the body, for example, rather than a tank of salt water. In 
such cases the flow rates may not be easy to determine or may vary with time. Similarly, the 
concentration may be far from uniform in some cases. Finally, the rates of inflow and outflow 
may be different, which means that the variation of the amount of liquid in the problem must 
also be taken into account. 
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EXAMPLE 

2 

Compound 

Interest 


Suppose that a sum of money is deposited in a bank or money fund that pays interest at an 
annual rate r. The value S(t) of the investment at any time t depends on the frequency with 
which interest is compounded as well as on the interest rate. Financial institutions have various 
policies concerning compounding: some compound monthly, some weekly, some even daily. 
If we assume that compounding takes place continuously , then we can set up an initial value 
problem that describes the growth of the investment. 

The rate of change of the value of the investment is dS/dt , and this quantity is equal to 
the rate at which interest accrues, which is the interest rate r times the current value of the 
investment S{t). Thus 

dS/dt = rS (11) 

is the differential equation that governs the process. Suppose that we also know the value of 
the investment at some particular time, say, 

5(0) = S 0 . (12) 

Then the solution of the initial value problem (11), (12) gives the balance S(t) in the account 
at any time t. This initial value problem is readily solved, since the differential equation (11) 
is both linear and separable. Consequently, by solving Eqs. (11) and (12), we find that 

Sit) = S,e rt . (13) 

Thus a bank account with continuously compounding interest grows exponentially. 

Let us now compare the results from this continuous model with the situation in which 
compounding occurs at finite time intervals. If interest is compounded once a year, then after 
t years 

S(t) = So(l + r ) f . 

If interest is compounded twice a year, then at the end of 6 months the value of the investment 
is So[ 1 + (r/2)], and at the end of 1 year it is 5 0 [1 + (r/2)] 2 . Thus, after t years we have 

/ r \ 2t 
S(t) = 5 0 (l + -) . 

In general, if interest is compounded m times per year, then 

/ r \ mt 

S(0 = 5o(l + -) . (14) 

V m/ 

The relation between formulas (13) and (14) is clarified if we recall from calculus that 

/ r \ mt 

lim So (1 H-) =S 0 e n . 

The same model applies equally well to more general investments in which dividends and 
perhaps capital gains can also accumulate, as well as interest. In recognition of this fact, we 
will from now on refer to r as the rate of return. 

Table 2.3.1 shows the effect of changing the frequency of compounding for a return rate 
r of 8%. The second and third columns are calculated from Eq. (14) for quarterly and daily 
compounding, respectively, and the fourth column is calculated from Eq. (13) for continuous 
compounding. The results show that the frequency of compounding is not particularly impor¬ 
tant in most cases. For example, during a 10-year period the difference between quarterly 
and continuous compounding is $17.50 per $1000 invested, or less than $2/year. The differ¬ 
ence would be somewhat greater for higher rates of return and less for lower rates. From the 
first row in the table, we see that for the return rate r = 8%, the annual yield for quarterly 
compounding is 8.24% and for daily or continuous compounding it is 8.33%. 

Returning now to the case of continuous compounding, let us suppose that there may be 
deposits or withdrawals in addition to the accrual of interest, dividends, or capital gains. If 
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TABLE 2.3.1 Growth of Capital at a Return Rate r = 8% 
for Several Modes of Compounding 


Years 

S(t)/S(to) fromEq. (14) 

S(t)/S(to) 
from Eq. (13) 

m = 4 

m = 365 

1 

1.0824 

1.0833 

1.0833 

2 

1.1717 

1.1735 

1.1735 

5 

1.4859 

1.4918 

1.4918 

10 

2.2080 

2.2253 

2.2255 

20 

4.8754 

4.9522 

4.9530 

30 

10.7652 

11.0203 

11.0232 

40 

23.7699 

24.5239 

24.5325 


we assume that the deposits or withdrawals take place at a constant rate k, then Eq. (11) is 
replaced by 

dS/dt = rS + k, 


or, in standard form, 

dS/dt - rS = k , (15) 

where k is positive for deposits and negative for withdrawals. 

Equation (15) is linear with the integrating factor e~ rt , so its general solution is 

S(t) = ce rt — ( k/r ), 

where c is an arbitrary constant. To satisfy the initial condition (12), we must choose 
c = S 0 + (k/r). Thus the solution of the initial value problem (15), (12) is 

S(t) = Soe rt + (k/r)(e n - 1). (16) 

The first term in expression (16) is the part of S(t) that is due to the return accumulated on 
the initial amount So, and the second term is the part that is due to the deposit or withdrawal 
rate k. 

The advantage of stating the problem in this general way without specific values for So, r, or 
k lies in the generality of the resulting formula (16) for S(t). With this formula we can readily 
compare the results of different investment programs or different rates of return. 

For instance, suppose that one opens an individual retirement account (IRA) at age 25 and 
makes annual investments of $2000 thereafter in a continuous manner. Assuming a rate of 
return of 8%, what will be the balance in the IRA at age 65? We have S 0 = 0, r = 0.08, and 
k = $2000, and we wish to determine S(40). From Eq. (16) we have 

S(40) = (25,000) (e 3 2 - 1) = $588,313. (17) 

It is interesting to note that the total amount invested is $80,000, so the remaining amount of 
$508,313 results from the accumulated return on the investment. The balance after 40 years 
is also fairly sensitive to the assumed rate. For instance, 5(40) = $508,948 if r — 0.075 and 
5(40) = $681,508 if r = 0.085. 

Let us now examine the assumptions that have gone into the model. First, we have assumed 
that the return is compounded continuously and that additional capital is invested continu¬ 
ously. Neither of these is true in an actual financial situation. We have also assumed that the 
return rate r is constant for the entire period involved, whereas in fact it is likely to fluctuate 
considerably. Although we cannot reliably predict future rates, we can use expression (16) to 
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determine the approximate effect of different rate projections. It is also possible to consider 
r and k in Eq. (15) to be functions of t rather than constants; in that case, of course, the solution 
may be much more complicated than Eq. (16). 

The initial value problem (15), (12) and the solution (16) can also be used to analyze a 
number of other financial situations, including annuities, mortgages, and automobile loans. 


Consider a pond that initially contains 10 million gal of fresh water. Water containing an 
EXAMPLE undesirable chemical flows into the pond at the rate of 5 million gal/yr, and the mixture in 

2 the pond flows out at the same rate. The concentration y(t) of chemical in the incoming water 

- varies periodically with time according to the expression y(t) = 2 + sin 2 1 g/gal. Construct a 

Chemicals in mathematical model of this flow process and determine the amount of chemical in the pond 

a Pond at any time. Plot the solution and describe in words the effect of the variation in the incoming 

concentration. 

Since the incoming and outgoing flows of water are the same, the amount of water in the 
pond remains constant at 10 7 gal. Let us denote time by t , measured in years, and the chemical 
by Q(t), measured in grams. This example is similar to Example 1, and the same inflow/outflow 
principle applies. Thus 

dQ 

—— = rate in — rate out, 

at 

where “rate in” and “rate out” refer to the rates at which the chemical flows into and out of 
the pond, respectively. The rate at which the chemical flows in is given by 

rate in = (5 x 10 6 ) gal/yr (2 + sin2t) g/gal. (18) 

The concentration of chemical in the pond is < 2 ( 0 / 10 7 g/gal, so the rate of flow out is 

rate out = (5 x 10 6 ) gal/yr [<2(0/10 7 ] g/gal = <2(0/2 g/yr. (19) 

Thus we obtain the differential equation 

^ = (5x 10 6 )(2 + sin 20 - g/f (20) 

where each term has the units of g/yr. 

To make the coefficients more manageable, it is convenient to introduce a new dependent 
variable defined by q(t) = Q(t) /10 6 , or <2(0 = 10 6 q(t). This means that q(t) is measured in 
millions of grams, or megagrams (metric tons). If we make this substitution in Eq. (20), then 
each term contains the factor 10 6 , which can be canceled. If we also transpose the term involving 
q(t ) to the left side of the equation, we finally have 

^ = 10 + 5 sin2t. (21) 

Originally, there is no chemical in the pond, so the initial condition is 

q( 0) = 0. (22) 

Equation (21) is linear, and although the right side is a function of time, the coefficient 
of q is a constant. Thus the integrating factor is e t/2 . Multiplying Eq. (21) by this factor and 
integrating the resulting equation, we obtain the general solution 

q{t) =20 — Yj cos 2t + sin 2 1 + ce~ t/2 . (23) 

The initial condition (22) requires that c = —300/17, so the solution of the initial value problem 
(21), (22) is 

q(t) = 20 - cos2 1+^ sin2; - 3 -^e~ t/2 . 


(24) 
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EXAMPLE 

4 

Escape 

Velocity 


A plot of the solution (24) is shown in Figure 2.3.3, along with the line q = 20. The exponential 
term in the solution is important for small t, but it diminishes rapidly as t increases. Later, the 
solution consists of an oscillation, due to the sin 2 1 and cos 2 1 terms, about the constant level 
q = 20. Note that if the sin2t term were not present in Eq. (21), then q = 20 would be the 
equilibrium solution of that equation. 



FIGURE 2.3.3 Solution of the initial value problem (21), (22): 
dq/dt + \q = 10 + 5sin2£, q(0) = 0. 


Let us now consider the adequacy of the mathematical model itself for this problem. 
The model rests on several assumptions that have not yet been stated explicitly. In the first 
place, the amount of water in the pond is controlled entirely by the rates of flow in and out— 
none is lost by evaporation or by seepage into the ground, and none is gained by rainfall. 
The same is true of the chemical; it flows into and out of the pond, but none is absorbed by 
fish or other organisms living in the pond. In addition, we assume that the concentration of 
chemical in the pond is uniform throughout the pond. Whether the results obtained from the 
model are accurate depends strongly on the validity of these simplifying assumptions. 


A body of constant mass m is projected away from the earth in a direction perpendicular to the 
earth’s surface with an initial velocity v 0 . Assuming that there is no air resistance, but taking 
into account the variation of the earth’s gravitational field with distance, find an expression 
for the velocity during the ensuing motion. Also find the initial velocity that is required to 
lift the body to a given maximum altitude £ above the surface of the earth, and find the 
least initial velocity for which the body will not return to the earth; the latter is the escape 
velocity. 

Let the positive x-axis point away from the center of the earth along the line of motion with 
x = 0 lying on the earth’s surface; see Figure 2.3.4. The figure is drawn horizontally to remind 
you that gravity is directed toward the center of the earth, which is not necessarily downward 
from a perspective away from the earth’s surface. The gravitational force acting on the body 
(that is, its weight) is inversely proportional to the square of the distance from the center of 
the earth and is given by w(x) = —k/(x + R) 2 , where k is a constant, R is the radius of the 
earth, and the minus sign signifies that w{x) is directed in the negative x direction. We know 







2.3 Modeling with First Order Equations 


59 



FIGURE 2.3.4 A body in the earth’s gravitational field. 


x 


that on the earth’s surface u;(0) is given by —mg, where g is the acceleration due to gravity at 
sea level. Therefore, k = mgR 2 and 


w(x) = — 


mgR 2 
(R+x) 2 ' 


Since there are no other forces acting on the body, the equation of motion is 

dv mgR 2 

m — =- 

dt (R + x) 2 ’ 


and the initial condition is 


v(0) = v 0 . 


(25) 


(26) 

(27) 


Unfortunately, Eq. (26) involves too many variables since it depends on t, x, and v. To 
remedy this situation, we can eliminate t from Eq. (26) by thinking of x, rather than t, as the 
independent variable. Then we can express dv/dt in terms of dv/dx by using the chain rule; 
hence 


dv dv dx dv 

dt dx dt dx ’ 


and Eq. (26) is replaced by 


dv gR 2 

V dx (R + x) 2 ' 


(28) 


Equation (28) is separable but not linear, so by separating the variables and integrating, we 
obtain 


2 


gR 2 

R + x 


T c. 


(29) 


Since x = 0 when t = 0, the initial condition (27) at t = 0 can be replaced by the condition that 
v = vq when x = 0. Hence c = (v%/2) — gR and 


v = ± ^-2gR+^. (30) 

Note that Eq. (30) gives the velocity as a function of altitude rather than as a function of time. 
The plus sign must be chosen if the body is rising, and the minus sign must be chosen if it is 
falling back to earth. 

To determine the maximum altitude £ that the body reaches, we set v = 0 and x = £ in 
Eq. (30) and then solve for £, obtaining 

fc _ v l R 


2 gR - f o ' 


(31) 
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Solving Eq. (31) for v 0 , we find the initial velocity required to lift the body to the altitude £, 
namely, 

<32) 

The escape velocity v e is then found by letting £ oo. Consequently, 

v e = V2gR- (33) 

The numerical value of v e is approximately 6.9 mi/s, or 11.1 km/s. 

The preceding calculation of the escape velocity neglects the effect of air resistance, so the 
actual escape velocity (including the effect of air resistance) is somewhat higher. On the other 
hand, the effective escape velocity can be significantly reduced if the body is transported a 
considerable distance above sea level before being launched. Both gravitational and frictional 
forces are thereby reduced; air resistance, in particular, diminishes quite rapidly with increasing 
altitude. You should keep in mind also that it may well be impractical to impart too large an 
initial velocity instantaneously; space vehicles, for instance, receive their initial acceleration 
during a period of a few minutes. 


PROBLEMS 


41 


1. Consider a tank used in certain hydrodynamic experiments. After one experiment the 
tank contains 200 L of a dye solution with a concentration of 1 g/L. To prepare for 
the next experiment, the tank is to be rinsed with fresh water flowing in at a rate of 
2 L/min, the well-stirred solution flowing out at the same rate. Find the time that will 
elapse before the concentration of dye in the tank reaches 1 % of its original value. 

2. A tank initially contains 120 L of pure water. A mixture containing a concentration of 
y g/L of salt enters the tank at a rate of 2 L/min, and the well-stirred mixture leaves the 
tank at the same rate. Find an expression in terms of y for the amount of salt in the tank 
at any time t. Also find the limiting amount of salt in the tank as t oo. 

3. A tank originally contains 100 gal of fresh water. Then water containing \ lb of salt per 
gallon is poured into the tank at a rate of 2 gal/min, and the mixture is allowed to leave at 
the same rate. After 10 min the process is stopped, and fresh water is poured into the tank 
at a rate of 2 gal/min, with the mixture again leaving at the same rate. Find the amount of 
salt in the tank at the end of an additional 10 min. 

4. A tank with a capacity of 500 gal originally contains 200 gal of water with 100 lb of salt 
in solution. Water containing 1 lb of salt per gallon is entering at a rate of 3 gal/min, and 
the mixture is allowed to flow out of the tank at a rate of 2 gal/min. Find the amount 
of salt in the tank at any time prior to the instant when the solution begins to overflow. 
Find the concentration (in pounds per gallon) of salt in the tank when it is on the point 
of overflowing. Compare this concentration with the theoretical limiting concentration if 
the tank had infinite capacity. 

5. A tank contains 100 gal of water and 50 oz of salt. Water containing a salt concentration of 
\{1 + \ sin t) oz/gal flows into the tank at a rate of 2 gal/min, and the mixture in the tank 
flows out at the same rate. 

(a) Find the amount of salt in the tank at any time. 

(b) Plot the solution for a time period long enough so that you see the ultimate behavior 
of the graph. 

(c) The long-time behavior of the solution is an oscillation about a certain constant level. 
What is this level? What is the amplitude of the oscillation? 
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6. Suppose that a tank containing a certain liquid has an outlet near the bottom. Let h(t) 
be the height of the liquid surface above the outlet at time t. Torricelli’s 2 principle states 
that the outflow velocity v at the outlet is equal to the velocity of a particle falling freely 
(with no drag) from the height h. 

(a) Show that v = yj2gh , where g is the acceleration due to gravity. 

(b) By equating the rate of outflow to the rate of change of liquid in the tank, show that 
h(t) satisfies the equation 

A(h)— = -aciyflgh, (i) 

where A (h) is the area of the cross section of the tank at height h and a is the area of the 
outlet. The constant a is a contraction coefficient that accounts for the observed fact that 
the cross section of the (smooth) outflow stream is smaller than a. The value of a for water 
is about 0.6. 

(c) Consider a water tank in the form of a right circular cylinder that is 3 m high above 
the outlet. The radius of the tank is 1 m, and the radius of the circular outlet is 0.1 m. 
If the tank is initially full of water, determine how long it takes to drain the tank down to 
the level of the outlet. 

7. Suppose that a sum So is invested at an annual rate of return r compounded continuously. 

(a) Find the time T required for the original sum to double in value as a function of r. 

(b) Determine T if r = 7%. 

(c) Find the return rate that must be achieved if the initial investment is to double in 
8 years. 

8. A young person with no initial capital invests k dollars per year at an annual rate of 
return r. Assume that investments are made continuously and that the return is 
compounded continuously. 

(a) Determine the sum S(t) accumulated at any time t. 

(b) If r = 7.5%, determine k so that $1 million will be available for retirement in 40 years. 

(c) If k = $2000/year, determine the return rate r that must be obtained to have $1 million 
available in 40 years. 

9. A certain college graduate borrows $8000 to buy a car. The lender charges interest at 
an annual rate of 10%. Assuming that interest is compounded continuously and that 
the borrower makes payments continuously at a constant annual rate k , determine the 
payment rate k that is required to pay off the loan in 3 years. Also determine how much 
interest is paid during the 3-year period. 

10. A home buyer can afford to spend no more than $1500/month on mortgage payments. 
Suppose that the interest rate is 6%, that interest is compounded continuously, and that 
payments are also made continuously. 

(a) Determine the maximum amount that this buyer can afford to borrow on a 20-year 
mortgage; on a 30-year mortgage. 

(b) Determine the total interest paid during the term of the mortgage in each of the cases 
in part (a). 


2 Evangelista Torricelli (1608-1647), successor to Galileo as court mathematician in Florence, published 
this result in 1644. He is also known for constructing the first mercury barometer and for making important 
contributions to geometry. 
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11. A home buyer wishes to borrow $250,000 at an interest rate of 6% to finance the pur¬ 
chase. Assume that interest is compounded continuously and that payments are also made 
continuously. 

(a) Determine the monthly payment that is required to pay off the loan in 20 years; 
in 30 years. 

(b) Determine the total interest paid during the term of the loan in each of the cases in 
part (a). 

12. A recent college graduate borrows $150,000 at an interest rate of 6% to purchase a con¬ 
dominium. Anticipating steady salary increases, the buyer expects to make payments at a 
monthly rate of 800 + 10 1, where t is the number of months since the loan was made. 

(a) Assuming that this payment schedule can be maintained, when will the loan be fully 
paid? 

(b) Assuming the same payment schedule, how large a loan could be paid off in exactly 
20 years? 

13. An important tool in archeological research is radiocarbon dating, developed by the 
American chemist Willard F. Libby. 3 This is a means of determining the age of certain wood 
and plant remains, and hence of animal or human bones or artifacts found buried at the 
same levels. Radiocarbon dating is based on the fact that some wood or plant remains con¬ 
tain residual amounts of carbon-14, a radioactive isotope of carbon. This isotope is accumu¬ 
lated during the lifetime of the plant and begins to decay at its death. Since the half-life of 
carbon-14 is long (approximately 5730 years 4 ), measurable amounts of carbon-14 remain 
after many thousands of years. If even a tiny fraction of the original amount of carbon-14 
is still present, then by appropriate laboratory measurements the proportion of the orig¬ 
inal amount of carbon-14 that remains can be accurately determined. In other words, if 
Q(t) is the amount of carbon-14 at time t and g 0 is the original amount, then the ratio 
Q(t)/Q 0 can be determined, as long as this quantity is not too small. Present measurement 
techniques permit the use of this method for time periods of 50,000 years or more. 

(a) Assuming that g satisfies the differential equation Q — —rQ , determine the decay 
constant r for carbon-14. 

(b) Find an expression for Q(t) at any time t , if g(0) = go. 

(c) Suppose that certain remains are discovered in which the current residual amount of 
carbon-14 is 20% of the original amount. Determine the age of these remains. 

14. Suppose that a certain population has a growth rate that varies with time and that this 
population satisfies the differential equation 

dy/dt = (0.5 + sinOy/5. 

(a) If y(0) = 1, find (or estimate) the time r at which the population has doubled. Choose 
other initial conditions and determine whether the doubling time r depends on the initial 
population. 

(b) Suppose that the growth rate is replaced by its average value 1/10. Determine the 
doubling time r in this case. 


3 Willard F. Libby (1908-1980) was born in rural Colorado and received his education at the University of 
California at Berkeley. He developed the method of radiocarbon dating beginning in 1947 while he was 
at the University of Chicago. For this work he was awarded the Nobel Prize in chemistry in 1960. 

4 McGraw-Hill Encyclopedia of Science and Technology (8th ed.) (New York: McGraw-Hill, 1997), Vol. 5, 
p. 48. 
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(c) Suppose that the term sin t in the differential equation is replaced by sin27rt; that is, 
the variation in the growth rate has a substantially higher frequency. What effect does this 
have on the doubling time r? 

(d) Plot the solutions obtained in parts (a), (b), and (c) on a single set of axes. 

15. Suppose that a certain population satisfies the initial value problem 

dy/dt = r(t)y - k , y(0) = y 0 , 


where the growth rate r(t) is given by r(t) = (1 + sin 0/5, and k represents the rate of 
predation. 

(a) Suppose that k = 1/5. Plot y versus t for several values of yo between 1/2 and 1. 

(b) Estimate the critical initial population y c below which the population will become 
extinct. 

(c) Choose other values of k and find the corresponding y c for each one. 

(d) Use the data you have found in parts (b) and (c) to plot y c versus k. 

16. Newton’s law of cooling states that the temperature of an object changes at a rate pro¬ 
portional to the difference between its temperature and that of its surroundings. Suppose 
that the temperature of a cup of coffee obeys Newton’s law of cooling. If the coffee has a 
temperature of 200°F when freshly poured, and 1 min later has cooled to 190°F in a room 
at 70°F, determine when the coffee reaches a temperature of 150°F. 

17. Heat transfer from a body to its surroundings by radiation, based on the Stefan- 
Boltzmann 5 law, is described by the differential equation 


where u(t ) is the absolute temperature of the body at time t, T is the absolute temperature 
of the surroundings, and a is a constant depending on the physical parameters of the body. 
However, if u is much larger than 7, then solutions of Eq. (i) are well approximated by 
solutions of the simpler equation 


Suppose that a body with initial temperature 2000 K is surrounded by a medium with 
temperature 300 K and that a = 2.0 x 10 -12 K _3 /s. 

(a) Determine the temperature of the body at any time by solving Eq. (ii). 

(b) Plot the graph of u versus t. 

(c) Find the time r at which u{x) = 600—that is, twice the ambient temperature. Up to this 
time the error in using Eq. (ii) to approximate the solutions of Eq. (i) is no more than 1 %. 

18. Consider an insulated box (a building, perhaps) with internal temperature u(t ). According 
to Newton’s law of cooling, u satisfies the differential equation 


du , _ 

— = -k[u - T(t)], 
dt 


(i) 


where T ( t ) is the ambient (external) temperature. Suppose that T ( t ) varies sinusoidally; 
for example, assume that T(t) = T 0 + T\ cos cot. 


5 Jozef Stefan (1835-1893), professor of physics at Vienna, stated the radiation law on empirical grounds 
in 1879. His student Ludwig Boltzmann (1844-1906) derived it theoretically from the principles of 
thermodynamics in 1884. Boltzmann is best known for his pioneering work in statistical mechanics. 
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(a) Solve Eq. (i) and express u(t ) in terms of t, k, T 0 , 7\, and co. Observe that part of 
your solution approaches zero as t becomes large; this is called the transient part. The 
remainder of the solution is called the steady state; denote it by S(t). 

(b) Suppose that t is measured in hours and that co = 7r/12, corresponding to a period of 
24 h for T(t). Further, let T 0 = 60°F, 7\ = 15°F, and k = 0.2/h. Draw graphs of S(t) and 
T(t) versus t on the same axes. From your graph estimate the amplitude R of the oscillatory 
part of S(t). Also estimate the time lag t between corresponding maxima of T(t) and S(t). 

(c) Let k , To, Ti, and co now be unspecified. Write the oscillatory part of S(t) in the form 
R cos[&>(£ — r)]. Use trigonometric identities to find expressions for R and r. Let T\ and co 
have the values given in part (b), and plot graphs of R and r versus k. 

19. Consider a lake of constant volume V containing at time t an amount Q(t ) of pollutant, 
evenly distributed throughout the lake with a concentration c(t ), where c(t ) = Q(t)/V. 
Assume that water containing a concentration k of pollutant enters the lake at a rate r, 
and that water leaves the lake at the same rate. Suppose that pollutants are also added 
directly to the lake at a constant rate P. Note that the given assumptions neglect a number 
of factors that may, in some cases, be important—for example, the water added or lost 
by precipitation, absorption, and evaporation; the stratifying effect of temperature differ¬ 
ences in a deep lake; the tendency of irregularities in the coastline to produce sheltered 
bays; and the fact that pollutants are deposited unevenly throughout the lake but (usually) 
at isolated points around its periphery. The results below must be interpreted in the light 
of the neglect of such factors as these. 

(a) If at time t = 0 the concentration of pollutant is co, find an expression for the 
concentration c(t) at any time. What is the limiting concentration as t oo? 

(b) If the addition of pollutants to the lake is terminated (k = 0 and P = 0 for t > 0), 
determine the time interval T that must elapse before the concentration of pollutants is 
reduced to 50% of its original value; to 10% of its original value. 

(c) Table 2.3.2 contains data 6 for several of the Great Lakes. Using these data, determine 
from part (b) the time T that is needed to reduce the contamination of each of these lakes 
to 10% of the original value. 


TABLE 2.3.2 Volume and Flow Data for the Great 
Lakes 


Lake 

V (km 3 x 10 3 ) 

r (km 3 /year) 

Superior 

12.2 

65.2 

Michigan 

4.9 

158 

Erie 

0.46 

175 

Ontario 

1.6 

209 


20. A ball with mass 0.15 kg is thrown upward with initial velocity 20 m/s from the roof of a 
building 30 m high. Neglect air resistance. 

(a) Find the maximum height above the ground that the ball reaches. 

(b) Assuming that the ball misses the building on the way down, find the time that it hits 
the ground. 

(c) Plot the graphs of velocity and position versus time. 


6 This problem is based on R. H. Rainey, “Natural Displacement of Pollution from the Great Lakes,’ 
Science 155 (1967), pp. 1242-1243; the information in the table was taken from that source. 
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21. Assume that the conditions are as in Problem 20 except that there is a force due to air 
resistance of magnitude |u|/30 directed opposite to the velocity, where the velocity v is 
measured in m/s. 

(a) Find the maximum height above the ground that the ball reaches. 

(b) Find the time that the ball hits the ground. 

(c) Plot the graphs of velocity and position versus time. Compare these graphs with the 
corresponding ones in Problem 20. 

41 22. Assume that the conditions are as in Problem 20 except that there is a force due to air 
resistance of magnitude v 2 /1325 directed opposite to the velocity, where the velocity v is 
measured in m/s. 

(a) Find the maximum height above the ground that the ball reaches. 

(b) Find the time that the ball hits the ground. 

(c) Plot the graphs of velocity and position versus time. Compare these graphs with the 
corresponding ones in Problems 20 and 21. 

41 23. A skydiver weighing 180 lb (including equipment) falls vertically downward from an alti¬ 
tude of 5000 ft and opens the parachute after 10 s of free fall. Assume that the force 
of air resistance, which is directed opposite to the velocity, is of magnitude 0.75 |u| when 
the parachute is closed and is of magnitude 12|u| when the parachute is open, where the 
velocity v is measured in ft/s. 

(a) Find the speed of the skydiver when the parachute opens. 

(b) Find the distance fallen before the parachute opens. 

(c) What is the limiting velocity v L after the parachute opens? 

(d) Determine how long the sky diver is in the air after the parachute opens. 

(e) Plot the graph of velocity versus time from the beginning of the fall until the skydiver 
reaches the ground. 

24. A rocket sled having an initial speed of 150 mi/h is slowed by a channel of water. Assume 
that during the braking process, the acceleration a is given by a(v) = — /xi> 2 , where v is the 
velocity and i± is a constant. 

(a) As in Example 4 in the text, use the relation dv/dt = v(dv/dx) to write the equation 
of motion in terms of v and x. 

(b) If it requires a distance of 2000 ft to slow the sled to 15 mi/h, determine the value of /x. 

(c) Find the time r required to slow the sled to 15 mi/h. 


25. A body of constant mass m is projected vertically upward with an initial velocity vo 
in a medium offering a resistance k\v\, where k is a constant. Neglect changes in the 
gravitational force. 

(a) Find the maximum height x m attained by the body and the time t m at which this 
maximum height is reached. 

(b) Show that if kvo/mg < 1, then t m and x m can be expressed as 

1 kv o 1 / kv 0 \ 2 

2 mg 3 \mg ) 

2 kvo 1 / kvo\ 2 

3 mg 2 \ mg ) 


t 


2g 


(c) Show that the quantity kv^/mg is dimensionless. 

26. A body of mass m is projected vertically upward with an initial velocity u 0 in a medium 
offering a resistance k\v\, where k is a constant. Assume that the gravitational attraction 
of the earth is constant. 

(a) Find the velocity v(t) of the body at any time. 
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(b) Use the result of part (a) to calculate the limit of i>(t) as k 0—that is, as the resis¬ 
tance approaches zero. Does this result agree with the velocity of a mass m projected 
upward with an initial velocity vq in a vacuum? 

(c) Use the result of part (a) to calculate the limit of v(t) as m ^ 0—that is, as the mass 
approaches zero. 

27. A body falling in a relatively dense fluid, oil for example, is acted on by three forces 
(see Figure 2.3.5): a resistive force R , a buoyant force B , and its weight w due to gravity. 
The buoyant force is equal to the weight of the fluid displaced by the object. For a slowly 
moving spherical body of radius a , the resistive force is given by Stokes’s law, R = 6jriia\v\, 
where v is the velocity of the body, and /x is the coefficient of viscosity of the surrounding 
fluid. 7 

(a) Find the limiting velocity of a solid sphere of radius a and density p falling freely in a 
medium of density p' and coefficient of viscosity /x. 

(b) In 1910 R. A. Millikan 8 studied the motion of tiny droplets of oil falling in an electric 
field. A field of strength E exerts a force Ee on a droplet with charge e. Assume that E 
has been adjusted so the droplet is held stationary (v = 0) and that w and B are as given 
above. Find an expression for e. Millikan repeated this experiment many times, and from 
the data that he gathered he was able to deduce the charge on an electron. 



▼ w 

FIGURE 2.3.5 A body falling in a dense fluid. 


4fl 28. A mass of 0.25 kg is dropped from rest in a medium offering a resistance of 0.2 |u|, where 
v is measured in m/s. 

(a) If the mass is dropped from a height of 30 m, find its velocity when it hits the ground. 

(b) If the mass is to attain a velocity of no more than 10 m/s, find the maximum height 
from which it can be dropped. 


7 Sir George Gabriel Stokes (1819-1903) was born in Ireland but for most of his life was at Cambridge 
University, first as a student and later as a professor. Stokes was one of the foremost applied mathemati¬ 
cians of the nineteenth century, best known for his work in fluid dynamics and the wave theory of light. 
The basic equations of fluid mechanics (the Navier-Stokes equations) are named partly in his honor, and 
one of the fundamental theorems of vector calculus bears his name. He was also one of the pioneers in 
the use of divergent (asymptotic) series. 

8 Robert A. Millikan (1868-1953) was educated at Oberlin College and Columbia University. Later he 
was a professor at the University of Chicago and California Institute of Technology. His determination of 
the charge on an electron was published in 1910. For this work, and for other studies of the photoelectric 
effect, he was awarded the Nobel Prize for Physics in 1923. 
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(c) Suppose that the resistive force is k\v\, where v is measured in m/s and A: is a constant. 
If the mass is dropped from a height of 30 m and must hit the ground with a velocity of 
no more than 10 m/s, determine the coefficient of resistance k that is required. 

Suppose that a rocket is launched straight up from the surface of the earth with initial 
velocity i>o = y/2gR, where R is the radius of the earth. Neglect air resistance. 

(a) Find an expression for the velocity v in terms of the distance x from the surface of the 
earth. 

(b) Find the time required for the rocket to go 240,000 mi (the approximate distance from 
the earth to the moon). Assume that R = 4000 mi. 

Let v(t) and w(t) be the horizontal and vertical components, respectively, of the velocity of 
a batted (or thrown) baseball. In the absence of air resistance, v and w satisfy the equations 

dv/dt = 0, dw/dt = —g. 

(a) Show that 

v = u cos A, w = — gt + usinA, 

where u is the initial speed of the ball and A is its initial angle of elevation. 

(b) Let x(t) and y (t) be the horizontal and vertical coordinates, respectively, of the ball at 
time t. If x(0) = 0 and y(0) = h , find x(t) and y(t) at any time t. 

(c) Let g = 32 ft/s 2 , u = 125 ft/s, and h = 3 ft. Plot the trajectory of the ball for several 
values of the angle A; that is, plot x(t) and y(t) parametrically. 

(d) Suppose the outfield wall is at a distance L and has height H. Find a relation between 
u and A that must be satisfied if the ball is to clear the wall. 

(e) Suppose that L = 350 ft and H = 10 ft. Using the relation in part (d), find (or estimate 
from a plot) the range of values of A that correspond to an initial velocity of u = 110 ft/s. 

(f) For L = 350 and H = 10, find the minimum initial velocity u and the corresponding 
optimal angle A for which the ball will clear the wall. 

4fl 31. A more realistic model (than that in Problem 30) of a baseball in flight includes the effect 
of air resistance. In this case the equations of motion are 

dv/dt = —rv, dw/dt = —g — rw, 

where r is the coefficient of resistance. 

(a) Determine v(t) and w(t) in terms of initial speed u and initial angle of elevation A. 

(b) Find x(t) and y(t) ifx(0) = 0 andy(0) = h. 

(c) Plot the trajectory of the ball for r = 1/5, u = 125, h = 3, and for several values of A. 
How do the trajectories differ from those in Problem 31 with r = 0? 

(d) Assuming that r = 1/5 and h = 3, find the minimum initial velocity u and the optimal 
angle A for which the ball will clear a wall that is 350 ft distant and 10 ft high. Compare 
this result with that in Problem 30(f). 

32. Brachistochrone Problem. One of the famous problems in the history of mathematics is 
the brachistochrone 9 problem: to find the curve along which a particle will slide without 
friction in the minimum time from one given point P to another Q, the second point being 
lower than the first but not directly beneath it (see Figure 2.3.6). This problem was posed 
by Johann Bernoulli in 1696 as a challenge problem to the mathematicians of his day. 


29. 


4fl 30. 


9 The word “brachistochrone” comes from the Greek words brachistos , meaning shortest, and chronos. 
meaning time. 
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Correct solutions were found by Johann Bernoulli and his brother Jakob Bernoulli and 
by Isaac Newton, Gottfried Leibniz, and the Marquis de L’Hopital. The brachistochrone 
problem is important in the development of mathematics as one of the forerunners of the 
calculus of variations. 

In solving this problem, it is convenient to take the origin as the upper point P and to 
orient the axes as shown in Figure 2.3.6. The lower point Q has coordinates (xo,yo)- ^ * s 
then possible to show that the curve of minimum time is given by a function y = 0(x) that 
satisfies the differential equation 

(1 +y ,2 )y = k 2 , (i) 

where k 2 is a certain positive constant to be determined later. 

(a) Solve Eq. (i) for /. Why is it necessary to choose the positive square root? 

(b) Introduce the new variable t by the relation 

y = k 2 sin 2 1. (ii) 

Show that the equation found in part (a) then takes the form 

2 k 2 sin 2 tdt = dx. (iii) 

(c) Letting 0 = 21, show that the solution of Eq. (iii) for which x = 0 when y = 0 is given by 

x = k 2 (0 — sin0)/2, y = k 2 (l — cos0)/2. (iv) 

Equations (iv) are parametric equations of the solution of Eq. (i) that passes through 
(0,0). The graph of Eqs. (iv) is called a cycloid. 

(d) If we make a proper choice of the constant k , then the cycloid also passes through the 
point (x 0 ,yo) and is the solution of the brachistochrone problem. Find k if x 0 = landy 0 = 2. 



FIGURE 2.3.6 The brachistochrone. 


2.4 Differences Between Linear and Nonlinear Equations 


Up to now, we have been primarily concerned with showing that first order differ¬ 
ential equations can be used to investigate many different kinds of problems in the 
natural sciences, and with presenting methods of solving such equations if they are 
either linear or separable. Now it is time to turn our attention to some more general 
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questions about differential equations and to explore in more detail some important 
ways in which nonlinear equations differ from linear ones. 

Existence and Uniqueness of Solutions. So far, we have discussed a number of initial value 
problems, each of which had a solution and apparently only one solution. That raises 
the question of whether this is true of all initial value problems for first order equa¬ 
tions. In other words, does every initial value problem have exactly one solution? 
This may be an important question even for nonmathematicians. If you encounter 
an initial value problem in the course of investigating some physical problem, you 
might want to know that it has a solution before spending very much time and effort 
in trying to find it. Further, if you are successful in finding one solution, you might 
be interested in knowing whether you should continue a search for other possible 
solutions or whether you can be sure that there are no other solutions. For linear 
equations, the answers to these questions are given by the following fundamental 
theorem. 


Theorem 2.4.1 If the functions p and g are continuous on an open interval I: a < t < p contain¬ 


ing the point t = to, then there exists a unique function y = 0(0 that satisfies the 
differential equation 


/ +p(t)y = g(0 


(i) 


for each t in /, and that also satisfies the initial condition 


( 2 ) 


y(to) = yo. 


where yo is an arbitrary prescribed initial value. 


Observe that Theorem 2.4.1 states that the given initial value problem has a solution 
and also that the problem has only one solution. In other words, the theorem asserts 
both the existence and the uniqueness of the solution of the initial value problem (1), 
(2). In addition, it states that the solution exists throughout any interval I containing 
the initial point to in which the coefficients p and g are continuous. That is, the solution 
can be discontinuous or fail to exist only at points where at least one of p and g is 
discontinuous. Such points can often be identified at a glance. 

The proof of this theorem is partly contained in the discussion in Section 2.1 leading 
to the formula [Eq. (32) in Section 2.1] 



(3) 


where [Eq. (30) in Section 2.1] 



(4) 


The derivation in Section 2.1 shows that if Eq. (1) has a solution, then it must be 
given by Eq. (3). By looking slightly more closely at that derivation, we can also 
conclude that the differential equation (1) must indeed have a solution. Since p is 
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continuous for a < t < /, it follows that /x is defined in this interval and is a nonzero 
differentiable function. Upon multiplying Eq. (1) by fi(t), we obtain 

m)y]' = (5) 

Since both /i and g are continuous, the function fig is integrable, and Eq. (3) follows 
from Eq. (5). Further, the integral of fig is differentiable, so y as given by Eq. (3) 
exists and is differentiable throughout the interval a < t < /3. By substituting the 
expression for y from Eq. (3) into either Eq. (1) or Eq. (5), you can verify that 
this expression satisfies the differential equation throughout the interval a < t < /. 
Finally, the initial condition (2) determines the constant c uniquely, so there is only 
one solution of the initial value problem; this completes the proof. 

Equation (4) determines the integrating factor fi(t) only up to a multiplicative 
factor that depends on the lower limit of integration. If we choose this lower limit to 
be to, then 

fi(t) = exp / p(s)ds, (6) 

Jto 


and it follows that fi(to) = 1. Using the integrating factor given by Eq. (6), and choos¬ 
ing the lower limit of integration in Eq. (3) also to be to, we obtain the general solution 
of Eq. (1) in the form 

1 

y m(0 

To satisfy the initial condition (2), we must choose c = yo- Thus the solution of the 
initial value problem (1), (2) is 


j 


H(s)g(s) ds + c 


( 7 ) 


1 

d(t) 


f 

J to 


fi(s)g(s) ds + yo , 


( 8 ) 


where fi(t) is given by Eq. (6). 

Turning now to nonlinear differential equations, we must replace Theorem 2.4.1 
by a more general theorem, such as the one that follows. 


Theorem 2.4.2 f unc ti° ns / an d 3//3y be continuous in some rectangle a < t < /3, 

y < y < 8 containing the point (to,yo). Then, in some interval to — h < t < to -\-h 
contained in a <t < p, there is a unique solution y = 0(0 of the initial value 
problem 

y'=f(t,y), y(t 0 )=yo■ (9) 


Observe that the hypotheses in Theorem 2.4.2 reduce to those in Theorem 2.4.1 if 
the differential equation is linear. In this case 

f(t,y) = —p(t)y + g(t) and df(t,y)/dy = -pit), 

so the continuity of / and df/dy is equivalent to the continuity of p and g. 

The proof of Theorem 2.4.1 was comparatively simple because it could be based 
on the expression (3) that gives the solution of an arbitrary linear equation. There 
is no corresponding expression for the solution of the differential equation (9), so 
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the proof of Theorem 2.4.2 is much more difficult. It is discussed to some extent in 
Section 2.8 and in greater depth in more advanced books on differential equations. 

Here we note that the conditions stated in Theorem 2.4.2 are sufficient to guarantee 
the existence of a unique solution of the initial value problem (9) in some interval 
to — h < t < to + h, but they are not necessary. That is, the conclusion remains true 
under slightly weaker hypotheses about the function /. In fact, the existence of a 
solution (but not its uniqueness) can be established on the basis of the continuity of 
/ alone. 

An important geometrical consequence of the uniqueness parts of Theorems 2.4.1 
and 2.4.2 is that the graphs of two solutions cannot intersect each other. Otherwise, 
there would be two solutions that satisfy the initial condition corresponding to the 
point of intersection, in contradiction to Theorem 2.4.1 or 2.4.2. 

We now consider some examples. 


EXAMPLE 

1 


Use Theorem 2.4.1 to find an interval in which the initial value problem 

ty' + 2 y = 41 2 , 

y( 1) = 2 

has a unique solution. 

Rewriting Eq. (10) in the standard form (1), we have 

/ + (2 /f)y = 41, 

so pit ) = 2/1 and g(t) = 41. Thus, for this equation, g is continuous for all t , while p is continuous 
only for t < 0 or for t > 0. The interval t > 0 contains the initial point; consequently, Theorem 
2.4.1 guarantees that the problem (10), (11) has a unique solution on the interval 0 < t < oo. 
In Example 4 of Section 2.1 we found the solution of this initial value problem to be 

y = t 2 + ^, t > 0. (12) 

Now suppose that the initial condition (11) is changed to y(— 1) = 2. Then Theorem 2.4.1 
asserts the existence of a unique solution for t < 0. As you can readily verify, the solution is 
again given by Eq. (12), but now on the interval — oo < t < 0. 


( 10 ) 

( 11 ) 


EXAMPLE 

2 


Apply Theorem 2.4.2 to the initial value problem 


dy 3x 2 + 4x + 2 

dx 2 (y — 1) 


y(0) = - 1 . 


(13) 


Note that Theorem 2.4.1 is not applicable to this problem since the differential equation is 
nonlinear. To apply Theorem 2.4.2, observe that 


f(x,y ) 


3x 2 “1 4x 2 

2(y -1) 


d Ax, y) 

dy K 9 * J 


3x 2 4~ 4x + 2 

2(y - 1) 2 


Thus each of these functions is continuous everywhere except on the line y = 1. Consequently, a 
rectangle can be drawn about the initial point (0, —1) in which both/ and df /dy are continuous. 
Therefore, Theorem 2.4.2 guarantees that the initial value problem has a unique solution in 
some interval about x = 0. However, even though the rectangle can be stretched infinitely 
far in both the positive and the negative x directions, this does not necessarily mean that the 
solution exists for all x. Indeed, the initial value problem (13) was solved in Example 2 of 
Section 2.2, and the solution exists only for x > —2. 
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Now suppose we change the initial condition to y(0) = 1. The initial point now lies on the 
line y = 1, so no rectangle can be drawn about it within which / and df/dy are continuous. 
Consequently, Theorem 2.4.2 says nothing about possible solutions of this modified problem. 
However, if we separate the variables and integrate, as in Section 2.2, we find that 

y 2 — 2y = x 3 + 2x 2 + 2x + c. 

Further, if x = 0 and y = 1, then c = — 1. Finally, by solving for y, we obtain 

y = 1 ± V* 3 + 2x 2 + 2x. (14) 

Equation (14) provides two functions that satisfy the given differential equation for x > 0 and 
also satisfy the initial condition y(0) = 1. 


EXAMPLE 

3 


Consider the initial value problem 

y' = y v \ y(0) = 0 (15) 

for t > 0. Apply Theorem 2.4.2 to this initial value problem and then solve the problem. 

The function f(t,y) = y 1/3 is continuous everywhere, but df/dy does not exist when y = 0, 
and hence it is not continuous there. Thus Theorem 2.4.2 does not apply to this problem, and 
no conclusion can be drawn from it. However, by the remark following Theorem 2.4.2, the 
continuity of / does ensure the existence of solutions, though not their uniqueness. 

To understand the situation more clearly, we must actually solve the problem, which is easy 
to do since the differential equation is separable. Thus we have 

y- 1/3 dy = dt, 


so 


and 


fy 2/3 - 


— t + c 


y = [|d + c)] 3/2 . 

The initial condition is satisfied if c = 0, so 

y = , t> o 

satisfies both of Eqs. (15). On the other hand, the function 

y = MO = - (f<) 3/2 , *>o 

is also a solution of the initial value problem. Moreover, the function 

y = f(t) = 0, t > 0 

is yet another solution. Indeed, for an arbitrary positive to, the functions 


y = X(0 = 


if 0 < t < to, 


±[j(t - t 0 )f /2 , iff > t 0 


(16) 


(17) 


(18) 


(19) 


are continuous, are differentiable (in particular at t = to), and are solutions of the initial value 
problem (15). Hence this problem has an infinite family of solutions; see Figure 2.4.1, where a 
few of these solutions are shown. 
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EXAMPLE 

4 


As already noted, the nonuniqueness of the solutions of the problem (15) does not contradict 
the existence and uniqueness theorem, since the theorem is not applicable if the initial point 
lies on the t-axis. If (to, yo) is any point not on the t-axis, however, then the theorem guarantees 
that there is a unique solution of the differential equation y' = y 1/3 passing through (to,yo). 



FIGURE 2.4.1 Several solutions of the initial value problem / = y 1/3 , y (0) = 0. 

Interval of Definition. According to Theorem 2.4.1, the solution of a linear equation (1) 

/ + p(t)y = g(t), 

subject to the initial condition y(to) = yo, exists throughout any interval about t = to 
in which the functions p and g are continuous. Thus vertical asymptotes or other 
discontinuities in the solution can occur only at points of discontinuity of p or g . 
For instance, the solutions in Example 1 (with one exception) are asymptotic to the 
y-axis, corresponding to the discontinuity at t = 0 in the coefficient p(t) = 2/t, but 
none of the solutions has any other point where it fails to exist and to be differentiable. 
The one exceptional solution shows that solutions may sometimes remain continuous 
even at points of discontinuity of the coefficients. 

On the other hand, for a nonlinear initial value problem satisfying the hypotheses 
of Theorem 2.4.2, the interval in which a solution exists may be difficult to determine. 
The solution y = 0(0 is certain to exist as long as the point [ t , 0 ( 0 ] remains within a 
region in which the hypotheses of Theorem 2.4.2 are satisfied. This is what determines 
the value of h in that theorem. However, since 0(0 is usually not known, it may be 
impossible to locate the point [ 00 ( 0 ] with respect to this region. In any case, the 
interval in which a solution exists may have no simple relationship to the function / 
in the differential equation y' = f(t,y). This is illustrated by the following example. 


Solve the initial value problem 

/=y 2 , y(0) = 1, (20) 

and determine the interval in which the solution exists. 

Theorem 2.4.2 guarantees that this problem has a unique solution since f(t,y) = y 2 and 
df/dy = 2 y are continuous everywhere. To find the solution, we separate the variables and 
integrate with the result that 


y 2 dy = dt 


( 21 ) 
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and 


-y- 1 =t + C. 


Then, solving for y, we have 


1 


y = - 


t + c' 


To satisfy the initial condition, we must choose c = —1, so 

1 


( 22 ) 


(23) 


is the solution of the given initial value problem. Clearly, the solution becomes unbounded as 
t 1; therefore, the solution exists only in the interval — oo < t < 1. There is no indication 
from the differential equation itself, however, that the point t = 1 is in any way remarkable. 
Moreover, if the initial condition is replaced by 


;v(0) = y 0 . 


(24) 


then the constant c in Eq. (22) must be chosen to be c = —1/yo, and it follows that 

1 -yot 


(25) 


is the solution of the initial value problem with the initial condition (24). Observe that the 
solution (25) becomes unbounded as t 1/yo, so the interval of existence of the solution 
is — oo < t < 1/yo if yo > 0, and is l/y 0 < t < oo if y 0 < 0- This example illustrates another 
feature of initial value problems for nonlinear equations: the singularities of the solution may 
depend in an essential way on the initial conditions as well as on the differential equation. 


General Solution. Another way in which linear and nonlinear equations differ concerns 
the concept of a general solution. For a first order linear equation it is possible to 
obtain a solution containing one arbitrary constant, from which all possible solutions 
follow by specifying values for this constant. For nonlinear equations this may not be 
the case; even though a solution containing an arbitrary constant may be found, there 
may be other solutions that cannot be obtained by giving values to this constant. For 
instance, for the differential equation / = y 2 in Example 4, the expression in Eq. (22) 
contains an arbitrary constant but does not include all solutions of the differential 
equation. To show this, observe that the function y = 0 for all t is certainly a solution of 
the differential equation, but it cannot be obtained from Eq. (22) by assigning a value 
to c. In this example we might anticipate that something of this sort might happen, 
because to rewrite the original differential equation in the form (21), we must require 
that y is not zero. However, the existence of “additional” solutions is not uncommon 
for nonlinear equations; a less obvious example is given in Problem 22. Thus we will 
use the term “general solution” only when discussing linear equations. 

Implicit Solutions. Recall again that for an initial value problem for a first order linear 
equation, Eq. (8) provides an explicit formula for the solution y = <j>(t). As long as 
the necessary antiderivatives can be found, the value of the solution at any point can 
be determined merely by substituting the appropriate value of t into the equation. 
The situation for nonlinear equations is much less satisfactory. Usually, the best that 
we can hope for is to find an equation 


F(t,y) = 0 


( 26 ) 
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involving t and y that is satisfied by the solution y = 0(t). Even this can be done 
only for differential equations of certain particular types, of which separable equa¬ 
tions are the most important. The equation (26) is called an integral, or first integral, 
of the differential equation, and (as we have already noted) its graph is an inte¬ 
gral curve, or perhaps a family of integral curves. Equation (26), assuming it can 
be found, defines the solution implicitly; that is, for each value of t we must solve 
Eq. (26) to find the corresponding value of y. If Eq. (26) is simple enough, it may 
be possible to solve it for y by analytical means and thereby obtain an explicit 
formula for the solution. However, more frequently this will not be possible, and 
you will have to resort to a numerical calculation to determine (approximately) the 
value of y for a given value of t. Once several pairs of values of t and y have been 
calculated, it is often helpful to plot them and then to sketch the integral curve 
that passes through them. You should arrange for a computer to do this for you, if 
possible. 

Examples 2, 3, and 4 are nonlinear problems in which it is easy to solve for an 
explicit formula for the solution y = <f>(t). On the other hand, Examples 1 and 3 
in Section 2.2 are cases in which it is better to leave the solution in implicit form 
and to use numerical means to evaluate it for particular values of the indepen¬ 
dent variable. The latter situation is more typical; unless the implicit relation is 
quadratic in y or has some other particularly simple form, it is unlikely that it can 
be solved exactly by analytical methods. Indeed, more often than not, it is impos¬ 
sible even to find an implicit expression for the solution of a first order nonlinear 
equation. 


Graphical or Numerical Construction of Integral Curves. Because of the difficulty in obtain¬ 
ing exact analytical solutions of nonlinear differential equations, methods that yield 
approximate solutions or other qualitative information about solutions are of corre¬ 
spondingly greater importance. We have already described, in Section 1.1, how the 
direction field of a differential equation can be constructed. The direction field can 
often show the qualitative form of solutions and can also be helpful in identifying 
regions of the ty-plane where solutions exhibit interesting features that merit more 
detailed analytical or numerical investigation. Graphical methods for first order equa¬ 
tions are discussed further in Section 2.5. An introduction to numerical methods for 
first order equations is given in Section 2.7, and a systematic discussion of numerical 
methods appears in Chapter 8. However, it is not necessary to study the numerical 
algorithms themselves in order to use effectively one of the many software pack¬ 
ages that generate and plot numerical approximations to solutions of initial value 
problems. 

Summary. The linear equation y' + p(t)y = g(t) has several nice properties that can 
be summarized in the following statements: 

1. Assuming that the coefficients are continuous, there is a general solution, containing an 
arbitrary constant, that includes all solutions of the differential equation. A particular 
solution that satisfies a given initial condition can be picked out by choosing the proper 
value for the arbitrary constant. 

2. There is an expression for the solution, namely, Eq. (7) or Eq. (8). Moreover, although it 
involves two integrations, the expression is an explicit one for the solution y = 0(7) rather 
than an equation that defines 0 implicitly. 
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3. The possible points of discontinuity, or singularities, of the solution can be identified 
(without solving the problem) merely by finding the points of discontinuity of the coeffi¬ 
cients. Thus, if the coefficients are continuous for all t , then the solution also exists and is 
differentiable for all t. 

None of these statements is true, in general, of nonlinear equations. Although a 
nonlinear equation may well have a solution involving an arbitrary constant, there 
may also be other solutions. There is no general formula for solutions of nonlinear 
equations. If you are able to integrate a nonlinear equation, you are likely to obtain an 
equation defining solutions implicitly rather than explicitly. Finally, the singularities 
of solutions of nonlinear equations can usually be found only by solving the equation 
and examining the solution. It is likely that the singularities will depend on the initial 
condition as well as on the differential equation. 


PROBLEMS In each of Problems 1 through 6, determine (without solving the problem) an interval in which 
the solution of the given initial value problem is certain to exist. 

1. (t - 3)/ + (In t)y = 2 1, y( 1) = 2 

2. t(t — 4)/ + y = 0, y(2) = 1 

3. y' + (tan t)y = sint, y(jz) = 0 4. (4 — t 2 )y' + 2 ty = 3 t 2 , y(—3) = 1 

5. (4 — t 2 )y' + 2 ty = 3 t 2 , y( 1) = —3 6. (In t)y' + y = cott, y(2) = 3 

In each of Problems 7 through 12, state where in the ty-plane the hypotheses of Theorem 2.4.2 


are 

satisfied. 




7. 

/ = 

t-y 

2 1 + 5y 

8. 

y = 

= d -t 2 -y 

9. 

/ = 

In \ty\ 

1 -t 2 +y 2 

10. 

/ = 

■-(t 2 +y 2 ) 3 ' 2 

11. 

dy 

1 + t 2 

12. 

dy 

(cot t)y 

dt 

"3 y-f 

dt 

1 +y 


In each of Problems 13 through 16, solve the given initial value problem and determine how 
the interval in which the solution exists depends on the initial value y 0 . 

13. / = -4 t/y, y(0) = y 0 14. / = 2 ty 2 , y( 0) = y 0 

15. y 1 + y 3 = 0, y(0) = y 0 16. / = t 2 /y( 1 + 1 3 ), y(0) = y 0 

In each of Problems 17 through 20, draw a direction field and plot (or sketch) several solutions 
of the given differential equation. Describe how solutions appear to behave as t increases and 
how their behavior depends on the initial value yo when t = 0. 

4fl 17. / = ty( 3 -y) 18. y’ = y( 3 - ty) 

19. y = -v(3 - ty) 20. y’ = t-\-y 2 

21. Consider the initial value problem y' — y 1/3 ,y(0) = 0 from Example 3 in the text. 

(a) Is there a solution that passes through the point (1,1)? If so, find it. 

(b) Is there a solution that passes through the point (2,1)? If so, find it. 

(c) Consider all possible solutions of the given initial value problem. Determine the set 
of values that these solutions have at t = 2. 
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22. (a) Verify that both yi(t) = 1 
problem 

/ = 

Where are these solutions valid? 

(b) Explain why the existence of two solutions of the given problem does not contradict 
the uniqueness part of Theorem 2.4.2. 

(c) Show that y = ct + c 2 , where c is an arbitrary constant, satisfies the differential 
equation in part (a) for t > —2c. If c = — 1, the initial condition is also satisfied, and 
the solution y = yi ( t ) is obtained. Show that there is no choice of c that gives the second 
solution y = y 2 (t). 

23. (a) Show that 0(0 = e 2t is a solution of / — 2y = 0 and that y = c0(O is also a solution 
of this equation for any value of the constant c. 

(b) Show that 0(0 = 1/t is a solution of / + y 2 = 0 for t > 0 but that y = ccj){t) is not 
a solution of this equation unless c = 0 or c = 1. Note that the equation of part (b) is 
nonlinear, while that of part (a) is linear. 

24. Show that if y = 0(0 is a solution of y' + p(t)y = 0, then y = c0(O is also a solution for 
any value of the constant c. 

25. Let y = y\(t) be a solution of 

/ + P(t)y = 0, (i) 

and let y = y 2 (t) be a solution of 

/ +p(!)y = g(t). (ii) 

Show that y = yi(t) + y 2 (0 is also a solution of Eq. (ii). 

26. (a) Show that the solution (7) of the general linear equation (1) can be written in the 
form 

y = cyi(t) +y 2 (t), (i) 


— t and y 2 (t) = — r/4 are solutions of the initial value 

- ,+ 'f+r >a>- -i. 


where c is an arbitrary constant. 

(b) Show that yi is a solution of the differential equation 

y' +p(t)y = 0, (ii) 


corresponding to g(t) = 0. 

(c) Show that y 2 is a solution of the full linear equation (1). We see later (for example, 
in Section 3.5) that solutions of higher order linear equations have a pattern similar to 
Eq. (i). 

Bernoulli Equations. Sometimes it is possible to solve a nonlinear equation by making a 
change of the dependent variable that converts it into a linear equation. The most important 
such equation has the form 

y r +p(t)y = q(t)y\ 

and is called a Bernoulli equation after Jakob Bernoulli. Problems 27 through 31 deal with 
equations of this type. 

27. (a) Solve Bernoulli’s equation when n = 0; when n = 1. 

(b) Show that if n ^ 0,1, then the substitution v = y x ~ n reduces Bernoulli’s equation to a 
linear equation. This method of solution was found by Leibniz in 1696. 
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In each of Problems 28 through 31, the given equation is a Bernoulli equation. In each case 
solve it by using the substitution mentioned in Problem 27(b). 

28. t 2 y' + 2ty — y 3 = 0, t > 0 

29. y = ry — ky 2 , r > 0 and k > 0. This equation is important in population dynamics and is 
discussed in detail in Section 2.5. 

30. y' — ey — ay 3 , e > 0 and a > 0. This equation occurs in the study of the stability of fluid 
flow. 

31. dy/dt = (r cos t + T)y — y 3 , where T and T are constants. This equation also occurs in the 
study of the stability of fluid flow. 

Discontinuous Coefficients. Linear differential equations sometimes occur in which one or 
both of the functions p and g have jump discontinuities. If to is such a point of discontinuity, 
then it is necessary to solve the equation separately for t < to and t > to. Afterward, the two 
solutions are matched so that y is continuous at t 0 ; this is accomplished by a proper choice of 
the arbitrary constants. The following two problems illustrate this situation. Note in each case 
that it is impossible also to make y' continuous at to. 

32. Solve the initial value problem 

y + 2y = g(t), y(0) = 0, 


where 



0<f <1, 

t > 1. 


33. Solve the initial value problem 


y+P(t)y = 0, y(0) = 1, 


where 



0 < t < 1, 
t > 1. 


2.5 Autonomous Equations and Population Dynamics 


An important class of first order equations consists of those in which the independent 
variable does not appear explicitly. Such equations are called autonomous and have 
the form 

dy/dt =f(y). (1) 

We will discuss these equations in the context of the growth or decline of the popula¬ 
tion of a given species, an important issue in fields ranging from medicine to ecology 
to global economics. A number of other applications are mentioned in some of the 
problems. Recall that in Sections 1.1 and 1.2 we considered the special case of Eq. (1) 
in which/(y) = ay + b. 

Equation (1) is separable, so the discussion in Section 2.2 is applicable to it, but the 
main purpose of this section is to show how geometrical methods can be used to obtain 
important qualitative information directly from the differential equation without 
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solving the equation. Of fundamental importance in this effort are the concepts 
of stability and instability of solutions of differential equations. These ideas were 
introduced informally in Chapter 1, but without using this terminology. They are 
discussed further here and will be examined in greater depth and in a more general 
setting in Chapter 9. 

Exponential Growth. Let y = 0(0 be the population of the given species at time t. The 
simplest hypothesis concerning the variation of population is that the rate of change 
of y is proportional 10 to the current value of y; that is, 

dy/dt = ry , ( 2 ) 

where the constant of proportionality r is called the rate of growth or decline, depend¬ 
ing on whether it is positive or negative. Here, we assume that r > 0, so the population 
is growing. 

Solving Eq. (2) subject to the initial condition 

y(0) = yo, (3) 

we obtain 

y = yoe rt . (4) 

Thus the mathematical model consisting of the initial value problem (2), (3) with 
r > 0 predicts that the population will grow exponentially for all time, as shown in 
Figure 2.5.1 for several values of yo - Under ideal conditions, Eq. (4) has been observed 
to be reasonably accurate for many populations, at least for limited periods of time. 
However, it is clear that such ideal conditions cannot continue indefinitely; eventually, 
limitations on space, food supply, or other resources will reduce the growth rate and 
bring an end to uninhibited exponential growth. 



FIGURE 2.5.1 Exponential growth: y versus t for dy/dt = ry (r > 0). 


10 It was apparently the British economist Thomas Malthus (1766-1834) who first observed that many 
biological populations increase at a rate proportional to the population. His first paper on populations 
appeared in 1798. 
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Logistic Growth. To take account of the fact that the growth rate actually depends on 
the population, we replace the constant r in Eq. (2) by a function h(y) and thereby 
obtain the modified equation 

dy/dt = h(y)y. (5) 

We now want to choose h(y) so that h(y) = r > 0 when y is small, h(y) decreases 
as y grows larger, and h(y) < 0 when y is sufficiently large. The simplest function that 
has these properties is h(y) = r — ay, where a is also a positive constant. Using this 
function in Eq. (5), we obtain 


dy/dt = (r — ay)y. (6) 

Equation (6) is known as the Verhulst 11 equation or the logistic equation. It is often 
convenient to write the logistic equation in the equivalent form 



where K = r/a. The constant r is called the intrinsic growth rate—that is, the growth 
rate in the absence of any limiting factors. The interpretation of K will become clear 
shortly. 

We will investigate the solutions of Eq. (7) in some detail later in this section. 
Before doing that, however, we will show how you can easily draw a qualitatively 
correct sketch of the solutions. The same methods also apply to the more general 
Eq. (1). 

We first seek solutions of Eq. (7) of the simplest possible type—that is, constant 
functions. For such a solution dy/dt = 0 for all t, so any constant solution of Eq. (7) 
must satisfy the algebraic equation 

r(l-y/K)y = 0. 

Thus the constant solutions are y = <pi(t) = 0 and y = 02 (0 = K. These solutions 
are called equilibrium solutions of Eq. (7) because they correspond to no change 
or variation in the value of y as t increases. In the same way, any equilibrium solu¬ 
tions of the more general Eq. (1) can be found by locating the roots of f(y) = 0. 
The zeros of f(y) are also called critical points. 

To visualize other solutions of Eq. (7) and to sketch their graphs quickly, we start 
by drawing the graph of f(y) versus y. In the case of Eq. (7),/(y) = r(l —y/K)y , 
so the graph is the parabola shown in Figure 2.5.2. The intercepts are (0,0) and 
( K , 0), corresponding to the critical points of Eq. (7), and the vertex of the parabola 
is (K/2,rK/4). Observe that dy/dt > 0 for 0 < y < K; therefore, y is an increasing 
function of t when y is in this interval; this is indicated by the rightward-pointing 


11 Pierre F. Verhulst (1804-1849) was a Belgian mathematician who introduced Eq. (6) as a model for 
human population growth in 1838. He referred to it as logistic growth so Eq. (6) is often called the logistic 
equation. He was unable to test the accuracy of his model because of inadequate census data, and it did 
not receive much attention until many years later. Reasonable agreement with experimental data was 
demonstrated by R. Pearl (1930) for Drosophila melanogaster (fruit fly) populations and by G. F. Gause 
(1935) for Paramecium and Tribolium (flour beetle) populations. 
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FIGURE 2.5.2 f(y) versus y for dy/dt = r( 1 — y/K)y. 


arrows near the y-axis in Figure 2.5.2. Similarly, if y > K, then dy/dt < 0; hence y is 
decreasing, as indicated by the leftward-pointing arrow in Figure 2.5.2. 

In this context the y-axis is often called the phase line, and it is reproduced in its 
more customary vertical orientation in Figure 2.53a. The dots at y = 0 and y = K 
are the critical points, or equilibrium solutions. The arrows again indicate that y is 
increasing whenever 0 < y < K and that y is decreasing whenever y > K. 

Further, from Figure 2.5.2, note that if y is near zero or K , then the slope f(y) is 
near zero, so the solution curves are relatively flat. They become steeper as the value 
of y leaves the neighborhood of zero or K. 

To sketch the graphs of solutions of Eq. (7) in the ty-plane, we start with the equi¬ 
librium solutions y = 0 and y = K; then we draw other curves that are increasing 
when 0 < y < K, decreasing when y > K, and flatten out as y approaches either of 
the values 0 or K. Thus the graphs of solutions of Eq. (7) must have the general shape 
shown in Figure 2.5.3 b, regardless of the values of r and K. 


y \ 

4 


°i 



FIGURE 2.5.3 Logistic growth: dy/dt = r( 1 - y/K)y. 
(a) The phase line, (b) Plots of y versus t. 
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Figure 2.5.3 b may seem to show that other solutions intersect the equilibrium 
solution y = K, but is this really possible? No, the uniqueness part of Theorem 2.4.2, 
the fundamental existence and uniqueness theorem, states that only one solution 
can pass through a given point in the ty-plane. Thus, although other solutions may 
be asymptotic to the equilibrium solution as t ^ oo, they cannot intersect it at any 
finite time. Consequently, a solution that starts in the interval 0 < y < K remains in 
this interval for all time, and similarly for a solution that starts in K < y < oo. 

To carry the investigation one step further, we can determine the concavity of the 
solution curves and the location of inflection points by finding d 2 y/dt 2 . From 
the differential equation (1), we obtain (using the chain rule) 


d 2 y d dy 
dt 2 dt dt 


j/(y) =f<y)% =f'(y)f(y )• 


( 8 ) 


The graph of y versus t is concave up when y" > 0—that is, when / and /' have the 
same sign. Similarly, it is concave down when y" < 0, which occurs when/ and /' have 
opposite signs. The signs of / and/' can be easily identified from the graph of f(y) 
versus y. Inflection points may occur when f(y) = 0. 

In the case of Eq. (7), solutions are concave up for 0 < y < K/2 where / is pos¬ 
itive and increasing (see Figure 2.5.2), so that both / and /' are positive. Solutions 
are also concave up for y > K where / is negative and decreasing (both / and /' are 
negative). For K/2 < y < K, solutions are concave down since here / is positive and 
decreasing, so/ is positive but/' is negative. There is an inflection point whenever the 
graph of y versus t crosses the line y = K/2. The graphs in Figure 2.5.3 b exhibit these 
properties. 

Finally, observe that K is the upper bound that is approached, but not exceeded, 
by growing populations starting below this value. Thus it is natural to refer to 

K as the saturation level, or the environmental carrying capacity, for the given 
species. 

A comparison of Figures 2.5.1 and 2.5.3 b reveals that solutions of the nonlinear 
equation (7) are strikingly different from those of the linear equation (1), at least 
for large values of t. Regardless of the value of K —that is, no matter how small 
the nonlinear term in Eq. (7)—solutions of that equation approach a finite value as 
t oo, whereas solutions of Eq. (1) grow (exponentially) without bound as t -> oo. 
Thus even a tiny nonlinear term in the differential equation (7) has a decisive effect 
on the solution for large t. 

In many situations it is sufficient to have the qualitative information about a solu¬ 
tion y = 4>(t) of Eq. (7) that is shown in Figure 2.53b. This information was obtained 
entirely from the graph off (y) versus y and without solving the differential equation 
(7). However, if we wish to have a more detailed description of logistic growth—for 
example, if we wish to know the value of the population at some particular time— 
then we must solve Eq. (7) subject to the initial condition (3). Provided that y / 0 
and y ^ K, we can write Eq. (7) in the form 

dy 

(1 ~y/K)y 


= r dt. 
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Using a partial fraction expansion on the left side, we have 

1 1 / K \ j 

—|- -1 dy = r dt. 

y i- y/K) - 

Then, by integrating both sides, we obtain 


In \y\ - In 




= rt + c. 


( 9 ) 


where c is an arbitrary constant of integration to be determined from the initial 
condition y(0) = yo. We have already noted that if 0 < yo < K, then y remains in 
this interval for all time. Thus in this case we can remove the absolute value bars 
in Eq. (9), and by taking the exponential of both sides, we find that 


y 

1 - (y/K) 


= Ce n 


( 10 ) 


where C = e c . In order to satisfy the initial condition v(0) = yo, we must choose 
C = yo/[l — (yo/fO]. Using this value for C in Eq. (10) and solving for y, we obtain 


ypK 

y 0 + (K - y 0 )c“ rt ' 


( 11 ) 


We have derived the solution (11) under the assumption that 0 < yo < K. If 
yo > K, then the details of dealing with Eq. (9) are only slightly different, and we 
leave it to you to show that Eq. (11) is also valid in this case. Finally, note that 
Eq. (11) also contains the equilibrium solutions y = fa(t) = 0 and y = fa(t) = K 
corresponding to the initial conditions yo = 0 and yo = K, respectively. 

All the qualitative conclusions that we reached earlier by geometrical reason¬ 
ing can be confirmed by examining the solution (11). In particular, if yo = 0, then 
Eq. (11) requires that y(t) = 0 for all t. If yo > 0, and if we let t -> oo in Eq. (11), 
then we obtain 


lim y(t) = yoK/yo = K. 

t—>oo 

Thus, for each yo > 0, the solution approaches the equilibrium solution y = fa (t) = K 
asymptotically as t ->► oo. Therefore, we say that the constant solution 02(0 = K is 
an asymptotically stable solution of Eq. (7) or that the point y = K is an asymp¬ 
totically stable equilibrium or critical point. After a long time, the population is 
close to the saturation level K regardless of the initial population size, as long as 
it is positive. Other solutions approach the equilibrium solution more rapidly as r 
increases. 

On the other hand, the situation for the equilibrium solution y = fa (t) = 0 is quite 
different. Even solutions that start very near zero grow as t increases and, as we have 
seen, approach K as t -> oo. We say that fa (t) = 0 is an unstable equilibrium solution 
or that y = 0 is an unstable equilibrium or critical point. This means that the only 
way to guarantee that the solution remains near zero is to make sure its initial value 
is exactly equal to zero. 
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EXAMPLE 

1 


The logistic model has been applied to the natural growth of the halibut population in certain 
areas of the Pacific Ocean. 12 Let y, measured in kilograms, be the total mass, or biomass, 
of the halibut population at time t. The parameters in the logistic equation are estimated to 
have the values r = 0.71/year and K = 80.5 x 10 6 kg. If the initial biomass is y 0 = 0.25 K, find 
the biomass 2 years later. Also find the time r for which y(z) = 0.15K. 

It is convenient to scale the solution (11) to the carrying capacity K ; thus we write Eq. (11) 
in the form 


y_ = _ yo/ K _ 

K (yo/K) + [1 - (yo/K)]e~ rt ' 


( 12 ) 


Using the data given in the problem, we find that 


3 * 2 ) 

K 


0.25 

0.25 + 0.75c- 1 - 42 


0.5797. 


Consequently, y(2) = 46.7 x 10 6 kg. 

To find r, we can first solve Eq. (12) for t. We obtain 


„ = (yo/K)[l - (y/K )] 
(y/K)[l — (yo/K)] ’ 

hence 

1 ln (yo/K)[l - (y/K)] 
r n (y/K)[ 1 - (yo/K)] ‘ 


(13) 


Using the given values of r and yo/K and setting y/K = 0.75, we find that 


1 (0.25)(0.25) 

071 ln (0.75) (0.75) 


0.71 


ln9 = 3.095 years. 


The graphs of y/K versus t for the given parameter values and for several initial conditions 
are shown in Figure 2.5.4. The black curve corresponds to the initial condition y 0 = 0.257C 



FIGURE 2.5.4 y/K versus t for population model of halibut in the Pacific 
Ocean. The black curve satisfies the initial condition y(0)/K = 0.25. 


12 A good source of information on the population dynamics and economics involved in making efficient 
use of a renewable resource, with particular emphasis on fisheries, is the book by Clark listed in the 
references at the end of this chapter. The parameter values used here are given on page 53 of this book 
and were obtained from a study by H. S. Mohring. 
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A Critical Threshold. We now turn to a consideration of the equation 



where r and T are given positive constants. Observe that (except for replacing the 
parameter K by T) this equation differs from the logistic equation (7) only in 
the presence of the minus sign on the right side. However, as we will see, the solutions 
of Eq. (14) behave very differently from those of Eq. (7). 

For Eq. (14) the graph of f(y) versus y is the parabola shown in Figure 2.5.5. 
The intercepts on the y-axis are the critical points y = 0 and y = T, corresponding 
to the equilibrium solutions = 0 and 02 (0 = T. If 0 < y < T, then dy/dt < 0, 
and y decreases as t increases. On the other hand, if y > T, then dy/dt > 0, and y 
grows as t increases. Thus 0i (t) = 0 is an asymptotically stable equilibrium solution 
and 02(0 = T is an unstable one. Further, f(y) is negative for 0 < y < T/2 and 
positive for T /2 < y < T, so the graph of y versus t is concave up and concave down, 
respectively, in these intervals. Also, f(y) is positive for y > T, so the graph of y 
versus t is also concave up there. 



FIGURE 2.5.5 f(y) versus y for dy/dt = —r( 1 - y/T)y. 


Figure 2.5.6 (a) shows the phase line (the y-axis) for Eq. (14). The dots at y = 0 and 
y = T are the critical points, or equilibrium solutions, and the arrows indicate where 
solutions are either increasing or decreasing. 

Solution curves of Eq. (14) can now be sketched quickly, as follows. First draw the 
equilibrium solutions y = 0 andy = T. Then sketch curves in the strip 0 < y < T that 
are decreasing as t increases and change concavity as they cross the line y —T/ 2. 
Next draw some curves above y = T that increase more and more steeply as t and y 
increase. Make sure that all curves become flatter as y approaches either zero or T . 
The result is Figure 2.5 .6(b), which is a qualitatively accurate sketch of solutions of 
Eq. (14) for any r and T. From this figure it appears that as time increases, y either 
approaches zero or grows without bound, depending on whether the initial value yo 
is less than or greater than T . Thus T is a threshold level, below which growth does 
not occur. 

We can confirm the conclusions that we have reached through geometrical rea¬ 
soning by solving the differential equation (14). This can be done by separating the 
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0 n 

(a) 



FIGURE 2.5.6 Growth with a threshold: dy/dt = —r( 1 — y/T)y. 
(a) The phase line. ( b ) Plots of y versus t. 


variables and integrating, just as we did for Eq. (7). However, if we note that Eq. (14) 
can be obtained from Eq. (7) by replacing K by T and r by — r, then we can make 
the same substitutions in the solution (11) and thereby obtain 


ypT 

yo + (T -y 0 )e rt ’ 


(15) 


which is the solution of Eq. (14) subject to the initial condition y(0) = yo. 

If 0 < yo < T, then it follows from Eq. (15) that y -> 0 as t -> oo. This agrees with 
our qualitative geometric analysis. If yo > T , then the denominator on the right side 
of Eq. (15) is zero for a certain finite value of t. We denote this value by t* and 
calculate it from 

yo - (yo - T)e rt * = 0, 


which gives 



To 

yo~T ' 


(16) 


Thus, if the initial population yo is above the threshold T, the threshold model predicts 
that the graph of y versus t has a vertical asymptote at t = t*; in other words, the 
population becomes unbounded in a finite time, whose value depends on yo, T, and r. 
The existence and location of this asymptote were not apparent from the geometric 
analysis, so in this case the explicit solution yields additional important qualitative, 
as well as quantitative, information. 

The populations of some species exhibit the threshold phenomenon. If too few 
are present, then the species cannot propagate itself successfully and the popula¬ 
tion becomes extinct. However, if the population is larger than the threshold level, 
then further growth occurs. Of course, the population cannot become unbounded, so 
eventually Eq. (14) must be modified to take this into account. 

Critical thresholds also occur in other circumstances. For example, in fluid mechan¬ 
ics, equations of the form (7) or (14) often govern the evolution of a small disturbance 
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y in a laminar (or smooth) fluid flow. For instance, if Eq. (14) holds and y < T, then 
the disturbance is damped out and the laminar flow persists. However, if y > T, 
then the disturbance grows larger and the laminar flow breaks up into a turbulent 
one. In this case T is referred to as the critical amplitude. Experimenters speak of 
keeping the disturbance level in a wind tunnel low enough so that they can study 
laminar flow over an airfoil, for example. 

Logistic Growth with a Threshold. As we mentioned in the last subsection, the threshold 
model (14) may need to be modified so that unbounded growth does not occur when 
y is above the threshold T. The simplest way to do this is to introduce another factor 
that will have the effect of making dy/dt negative when y is large. Thus we consider 

where r > 0 and 0 < T < K. 

The graph of f(y) versus y is shown in Figure 2.5.7. In this problem there are three 
critical points, y = 0, y = T, and y = K, corresponding to the equilibrium solutions 
0i(O = 0, 02 (0 = T, and 03 (t) = K, respectively. From Figure 2.5.7 we observe that 
dy/dt > 0 for T < y < K, and consequently y is increasing there. Further, dy/dt < 0 
for y < T and for y > K, so y is decreasing in these intervals. Consequently, the 
equilibrium solutions 0i (t) and 03 (t) are asymptotically stable, and the solution 02 (t) 
is unstable. 



FIGURE 2.5.7 f(y) versus y for dy/dt = -r(l —y/T)( 1 — y/K)y. 


The phase line for Eq. (17) is shown in Figure 2.5 .8a, and the graphs of some 
solutions are sketched in Figure 2.5.8b. You should make sure that you understand 
the relation between these two figures, as well as the relation between Figures 2.5.7 
and 2.5.8 a. From Figure 2.5 .8b we see that if y starts below the threshold T, then 
y declines to ultimate extinction. On the other hand, if y starts above T, then y 
eventually approaches the carrying capacity K. The inflection points on the graphs 
of y versus t in Figure 2.5 .8b correspond to the maximum and minimum points, y\ 
and y 2, respectively, on the graph of f(y) versus y in Figure 2.5.7. These values can 
be obtained by differentiating the right side of Eq. (17) with respect to y, setting the 
result equal to zero, and solving for y. We obtain 

yi, 2 = (K+T± 4k 1 -KT+ T 2 )/3, (18) 

where the plus sign yields yi and the minus sign y 2 . 
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PROBLEMS 


y \ 


A 


A 

°T 

(a) 

FIGURE 2.5.8 Logistic growth with a threshold: dy/dt = —r( 1 — y/T)( 1 — y/K)y. 

{a) The phase line. ( b ) Plots of y versus t. 

A model of this general sort apparently describes the population of the passen¬ 
ger pigeon, 13 which was present in the United States in vast numbers until late in the 
nineteenth century. It was heavily hunted for food and for sport, and consequently its 
numbers were drastically reduced by the 1880s. Unfortunately, the passenger pigeon 
could apparently breed successfully only when present in a large concentration, cor¬ 
responding to a relatively high threshold T. Although a reasonably large number of 
individual birds remained alive in the late 1880s, there were not enough in any one 
place to permit successful breeding, and the population rapidly declined to extinc¬ 
tion. The last survivor died in 1914. The precipitous decline in the passenger pigeon 
population from huge numbers to extinction in a few decades was one of the early 
factors contributing to a concern for conservation in this country. 



Problems 1 through 6 involve equations of the form dy/dt = f(y). In each problem sketch the 
graph of f(y) versus y, determine the critical (equilibrium) points, and classify each one as 
asymptotically stable or unstable. Draw the phase line, and sketch several graphs of solutions 
in the ty-plane. 

1. dy/dt = ay + by 2 , a > 0, b > 0, yo > 0 

2. dy/dt = ay + by 2 , a > 0, b > 0, —oo < yo < oo 

3. dy/dt = y(y- 1 )(y - 2), y 0 > 0 

4. dy/dt = e y — 1, —oo < y 0 < oo 

5. dy/dt = e~ y — 1, —oo < y 0 < oo 

6. dy/dt = —2(arctany)/(l -by 2 ), —oo < y 0 < oo 

7. Semistable Equilibrium Solutions. Sometimes a constant equilibrium solution has the 
property that solutions lying on one side of the equilibrium solution tend to approach it, 


13 See, for example, Oliver L. Austin, Jr., Birds of the World (New York: Golden Press, 1983), pp. 143-145. 
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whereas solutions lying on the other side depart from it (see Figure 2.5.9). In this case the 
equilibrium solution is said to be semistable. 

(a) Consider the equation 


dy/dt = k(l - y) 2 , (i) 

where k is a positive constant. Show that y = 1 is the only critical point, with the 
corresponding equilibrium solution 4>{t) = 1. 

(b) Sketch /(y) versus y. Show that y is increasing as a function of t for y < 1 and also 
for y > 1. The phase line has upward-pointing arrows both below and above y = 1. Thus 
solutions below the equilibrium solution approach it, and those above it grow farther away. 
Therefore, 4>{t) = 1 is semistable. 

(c) Solve Eq. (i) subject to the initial condition y(0) = y 0 and confirm the conclusions 
reached in part (b). 



FIGURE 2.5.9 In both cases the equilibrium solution 4>{t) = k is semistable. 
(a) dy/dt < 0; ( b ) dy/dt > 0. 


Problems 8 through 13 involve equations of the form dy/dt =f(y). In each problem sketch 
the graph of f(y) versus y, determine the critical (equilibrium) points, and classify each one 
asymptotically stable, unstable, or semistable (see Problem 7). Draw the phase line, and sketch 
several graphs of solutions in the ty-plane. 


8. dy/dt = — k(y — l) 2 , 

9. dy/dt =y 2 (y 2 - 1), 

10. dy/dt = y(\ — y 2 ), 

11. dy/dt = ay — b^/y, 


12. dy/dt = y 2 (4 

13. dy/dt = y 2 (l ■ 


-y), 
-y) 2 , 


k > 0, —oo < y 0 < oo 
—oo < y 0 < oo 
—oo < y 0 < oo 
a > 0, b > 0, yo > 0 
—oo < yo < oo 
—oo < yo < oo 


14. Consider the equation dy/dt— f(y) and suppose that yi is a critical point—that is, 
f(yi) = 0. Show that the constant equilibrium solution (p(t ) = yi is asymptotically stable 
if/'(yi) < 0 and unstable if/'(yi) > 0. 


15. Suppose that a certain population obeys the logistic equation dy/dt = ry[ 1 — (y/K )]. 

(a) If y 0 = K/3, find the time r at which the initial population has doubled. Find the value 
of t corresponding to r = 0.025 per year. 

(b) If yo/K = a , find the time T at which y(T)/K = /3, where 0 < a, < 1. Observe that 
T -> oo as a 0 or as p 1. Find the value of T for r = 0.025 per year, a = 0.1, and 
/3 = 0.9. 
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16. Another equation that has been used to model population growth is the Gompertz 14 
equation 


dy/dt = ry\n(K/y ), 


where r and K are positive constants. 

(a) Sketch the graph of f(y) versus y, find the critical points, and determine whether each 
is asymptotically stable or unstable. 

(b) For 0 < y < K, determine where the graph of y versus t is concave up and where it is 
concave down. 

(c) For each y in 0 < y < K, show that dy/dt as given by the Gompertz equation is never 
less than dy/dt as given by the logistic equation. 

17. (a) Solve the Gompertz equation 


dy/dt = ry\n(K/y), 


subject to the initial condition y(0) = y 0 . 

Hint: You may wish to let u = In (y/K). 

(b) For the data given in Example 1 in the text (r = 0.71 per year, K = 80.5 x 10 6 kg, 
yo/K = 0.25), use the Gompertz model to find the predicted value of y(2). 

(c) For the same data as in part (b), use the Gompertz model to find the time r at which 
y( r) = 0.15K. 

18. A pond forms as water collects in a conical depression of radius a and depth h. Suppose that 
water flows in at a constant rate k and is lost through evaporation at a rate proportional 
to the surface area. 

(a) Show that the volume V(t) of water in the pond at time t satisfies the differential 
equation 

dV/dt = k- a7t(3a/7th) 2/3 V 2/3 , 


where a is the coefficient of evaporation. 

(b) Find the equilibrium depth of water in the pond. Is the equilibrium asymptotically 
stable? 

(c) Find a condition that must be satisfied if the pond is not to overflow. 

19. Consider a cylindrical water tank of constant cross section A. Water is pumped into the 
tank at a constant rate k and leaks out through a small hole of area a in the bottom 
of the tank. From Torricelli’s principle in hydrodynamics (see Problem 6 in Section 2.3) 
it follows that the rate at which water flows through the hole is aa^/lgh, where h is the 
current depth of water in the tank, g is the acceleration due to gravity, and a is a contraction 
coefficient that satisfies 0.5 < a < 1.0. 

(a) Show that the depth of water in the tank at any time satisfies the equation 

dh/dt= (k — aa^lgh ) /A. 

(b) Determine the equilibrium depth h e of water, and show that it is asymptotically stable. 
Observe that h e does not depend on A. 


14 Benjamin Gompertz (1779-1865) was an English actuary. He developed his model for population growth, 
published in 1825, in the course of constructing mortality tables for his insurance company. 
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Harvesting a Renewable Resource. Suppose that the population y of a certain species of fish 
(for example, tuna or halibut) in a given area of the ocean is described by the logistic equation 

dy/dt = r( 1 - y/K)y. 

Although it is desirable to utilize this source of food, it is intuitively clear that if too many fish 
are caught, then the fish population may be reduced below a useful level and possibly even 
driven to extinction. Problems 20 and 21 explore some of the questions involved in formulating 
a rational strategy for managing the fishery. 15 

20. At a given level of effort, it is reasonable to assume that the rate at which fish are caught 
depends on the population y: the more fish there are, the easier it is to catch them. Thus we 
assume that the rate at which fish are caught is given by Ey, where E is a positive constant, 
with units of 1/time, that measures the total effort made to harvest the given species of 
fish. To include this effect, the logistic equation is replaced by 

dy/dt = r( \ - y/K)y - Ey. (i) 

This equation is known as the Schaefer model after the biologist M. B. Schaefer, who 
applied it to fish populations. 

(a) Show that if E < r, then there are two equilibrium points, y\ = 0 and 
y 2 = K(1 - E/r) > 0. 

(b) Show that y = yi is unstable and y = y 2 is asymptotically stable. 

(c) A sustainable yield Y of the fishery is a rate at which fish can be caught indefinitely. 
It is the product of the effort E and the asymptotically stable population y 2 . Find Y as a 
function of the effort E\ the graph of this function is known as the yield-effort curve. 

(d) Determine E so as to maximize Y and thereby find the maximum sustainable yield Y m . 

21. In this problem we assume that fish are caught at a constant rate h independent of the size 
of the fish population. Then y satisfies 

dy/dt = r( 1 - y/K)y — h. (i) 

The assumption of a constant catch rate h may be reasonable when y is large but becomes 
less so when y is small. 

(a) If h < rK/4, show that Eq. (i) has two equilibrium points yi and y 2 with yi < y 2 ; 
determine these points. 

(b) Show that yi is unstable and y 2 is asymptotically stable. 

(c) From a plot of f(y) versus y, show that if the initial population y 0 > yi, then y y 2 
as t oo, but that if y 0 < yu then y decreases as t increases. Note that y = 0 is not an 
equilibrium point, so if y 0 < yi, then extinction will be reached in a finite time. 

(d) If h > rK/4 , show that y decreases to zero as t increases, regardless of the value of y 0 . 

(e) If h = rK/4 , show that there is a single equilibrium point y = K/2 and that this point 
is semistable (see Problem 7). Thus the maximum sustainable yield is h m = rK/4 , corre¬ 
sponding to the equilibrium value y = K/2. Observe that h m has the same value as Y m 
in Problem 20(d). The fishery is considered to be overexploited if y is reduced to a level 
below K/2. 


15 An excellent treatment of this kind of problem, which goes far beyond what is outlined here, may be 
found in the book by Clark mentioned previously, especially in the first two chapters. Numerous additional 
references are given there. 
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Epidemics. The use of mathematical methods to study the spread of contagious diseases 
goes back at least to some work by Daniel Bernoulli in 1760 on smallpox. In more recent years 
many mathematical models have been proposed and studied for many different diseases. 16 
Problems 22 through 24 deal with a few of the simpler models and the conclusions that can be 
drawn from them. Similar models have also been used to describe the spread of rumors and 
of consumer products. 

22. Suppose that a given population can be divided into two parts: those who have a given 
disease and can infect others, and those who do not have it but are susceptible. Let x be the 
proportion of susceptible individuals and y the proportion of infectious individuals; then 
x + y = 1. Assume that the disease spreads by contact between sick and well members of 
the population and that the rate of spread dy/dt is proportional to the number of such 
contacts. Further, assume that members of both groups move about freely among each 
other, so the number of contacts is proportional to the product of x and y. Since x = 1 — y, 
we obtain the initial value problem 

dy/dt = ay( 1 - y), y(0) = y 0 , (i) 

where a is a positive proportionality factor, and y 0 is the initial proportion of infectious 
individuals. 

(a) Find the equilibrium points for the differential equation (i) and determine whether 
each is asymptotically stable, semistable, or unstable. 

(b) Solve the initial value problem (i) and verify that the conclusions you reached in 
part (a) are correct. Show that y(0 -> 1 as t -> oo, which means that ultimately the disease 
spreads through the entire population. 

23. Some diseases (such as typhoid fever) are spread largely by carriers , individuals who can 
transmit the disease but who exhibit no overt symptoms. Let x and y denote the propor¬ 
tions of susceptibles and carriers, respectively, in the population. Suppose that carriers are 
identified and removed from the population at a rate /3, so 

dy/dt = -fiy. (i) 

Suppose also that the disease spreads at a rate proportional to the product of x and y\ thus 

dx/dt = —axy. (ii) 

(a) Determine y at any time t by solving Eq. (i) subject to the initial condition y(0) = y 0 - 

(b) Use the result of part (a) to find x at any time t by solving Eq. (ii) subject to the initial 
condition x(0) =xo. 

(c) Find the proportion of the population that escapes the epidemic by finding the limiting 
value of x as t oo. 

24. Daniel Bernoulli’s work in 1760 had the goal of appraising the effectiveness of a contro¬ 
versial inoculation program against smallpox, which at that time was a major threat to 
public health. His model applies equally well to any other disease that, once contracted 
and survived, confers a lifetime immunity. 

Consider the cohort of individuals born in a given year (t = 0), and let n(t) be the 
number of these individuals surviving t years later. Let x(t) be the number of members of 
this cohort who have not had smallpox by year t and who are therefore still susceptible. 
Let p be the rate at which susceptibles contract smallpox, and let v be the rate at which 


16 A standard source is the book by Bailey listed in the references. The models in Problems 22, 23, and 
24 are discussed by Bailey in Chapters 5,10, and 20, respectively. 
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people who contract smallpox die from the disease. Finally, let /x(t) be the death rate from 
all causes other than smallpox. Then dx/dt , the rate at which the number of susceptibles 
declines, is given by 

dx/dt = — [/3 + fi(t)]x. (i) 

The first term on the right side of Eq. (i) is the rate at which susceptibles contract smallpox, 
and the second term is the rate at which they die from all other causes. Also 

dn/dt = —vfix — ii (t)n, (ii) 

where dn/dt is the death rate of the entire cohort, and the two terms on the right side are 
the death rates due to smallpox and to all other causes, respectively. 

(a) Let z = x/n, and show that z satisfies the initial value problem 

dz/dt = -Pz(l - vz), z(0) = 1. (iii) 

Observe that the initial value problem (iii) does not depend on /i(t). 

(b) Find z(t) by solving Eq. (iii). 

(c) Bernoulli estimated that v = ft = Using these values, determine the proportion of 
20-year-olds who have not had smallpox. 

Note: On the basis of the model just described and the best mortality data available at the 
time, Bernoulli calculated that if deaths due to smallpox could be eliminated (v = 0), then 
approximately 3 years could be added to the average life expectancy (in 1760) of 26 years, 
7 months. He therefore supported the inoculation program. 

Bifurcation Points. For an equation of the form 

dy/dt =f(a,y), (i) 

where a is a real parameter, the critical points (equilibrium solutions) usually depend on the 
value of a. As a steadily increases or decreases, it often happens that at a certain value of a, called 
a bifurcation point, critical points come together, or separate, and equilibrium solutions may 
be either lost or gained. Bifurcation points are of great interest in many applications, because 
near them the nature of the solution of the underlying differential equation is undergoing an 
abrupt change. For example, in fluid mechanics a smooth (laminar) flow may break up and 
become turbulent. Or an axially loaded column may suddenly buckle and exhibit a large lateral 
displacement. Or, as the amount of one of the chemicals in a certain mixture is increased, spiral 
wave patterns of varying color may suddenly emerge in an originally quiescent fluid. Problems 
25 through 27 describe three types of bifurcations that can occur in simple equations of the 
form (i). 

25. Consider the equation 

dy/dt — a — y 2 . (ii) 

(a) Find all of the critical points for Eq. (ii). Observe that there are no critical points if 
a < 0, one critical point if a = 0, and two critical points if a > 0. 

(b) Draw the phase line in each case and determine whether each critical point is 
asymptotically stable, semistable, or unstable. 

(c) In each case sketch several solutions of Eq. (ii) in the ty-plane. 

(d) If we plot the location of the critical points as a function of a in the ay- plane, we obtain 
Figure 2.5.10. This is called the bifurcation diagram for Eq. (ii). The bifurcation at a = 0 
is called a saddle-node bifurcation. This name is more natural in the context of second 
order systems, which are discussed in Chapter 9. 
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FIGURE 2.5.10 

Bifurcation diagram for y' = a — y 2 . 


26. Consider the equation 

dy/dt = ay — y 3 = y(a — y 2 ). (iii) 

(a) Again consider the cases a < 0, a = 0, and a > 0. In each case find the critical points, 
draw the phase line, and determine whether each critical point is asymptotically stable, 
semistable, or unstable. 

(b) In each case sketch several solutions of Eq. (iii) in the ty-plane. 

(c) Draw the bifurcation diagram for Eq. (iii)—that is, plot the location of the critical 
points versus a. For Eq. (iii) the bifurcation point at a = 0 is called a pitchfork bifurcation. 
Your diagram may suggest why this name is appropriate. 

27. Consider the equation 

dy/dt — ay — y 2 — y(a — y). (iv) 

(a) Again consider the cases a < 0, a = 0, and a > 0. In each case find the critical points, 
draw the phase line, and determine whether each critical point is asymptotically stable, 
semistable, or unstable. 

(b) In each case sketch several solutions of Eq. (iv) in the ty-plane. 

(c) Draw the bifurcation diagram for Eq. (iv). Observe that for Eq. (iv) there are the 
same number of critical points for a < 0 and a > 0 but that their stability has changed. 
For a < 0 the equilibrium solution y = 0 is asymptotically stable and y = a is unstable, 
while for a > 0 the situation is reversed. Thus there has been an exchange of stability as a 
passes through the bifurcation point a = 0. This type of bifurcation is called a transcritical 
bifurcation. 

28. Chemical Reactions. A second order chemical reaction involves the interaction (colli¬ 
sion) of one molecule of a substance P with one molecule of a substance Q to produce 
one molecule of a new substance X\ this is denoted by P + Q -> X. Suppose that p and 
q , where p ^ q, are the initial concentrations of P and Q, respectively, and let x(t) be the 
concentration of X at time t. Then p — x(t) and q — x(t) are the concentrations of P and 
Q at time t, and the rate at which the reaction occurs is given by the equation 

dx/dt = a(p — x)(q — x), (i) 


where a is a positive constant. 

(a) If jc(0) = 0, determine the limiting value of x(t) as t -> oo without solving the 
differential equation. Then solve the initial value problem and find x(t) for any t. 
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(b) If the substances P and Q are the same, then p = q and Eq. (i) is replaced by 

dx/dt = a(p — x) 2 . (ii) 

If x(0) == 0, determine the limiting value of x(t) as t oo without solving the differential 

equation. Then solve the initial value problem and determine x(t) for any t. 


2.6 Exact Equations and Integrating Factors 


For first order equations there are a number of integration methods that are applica¬ 
ble to various classes of problems. The most important of these are linear equations 
and separable equations, which we have discussed previously. Here, we consider a 
class of equations known as exact equations for which there is also a well-defined 
method of solution. Keep in mind, however, that those first order equations that 
can be solved by elementary integration methods are rather special; most first order 
equations cannot be solved in this way. 


EXAMPLE 

1 


Solve the differential equation 

2x + y 2 + 2xyy' = 0. 


a) 


The equation is neither linear nor separable, so the methods suitable for those types of 
equations are not applicable here. However, observe that the function i//(x, y) = x 2 + xy 2 has 
the property that 


_ 2 di// 

2x+y 2 = —, 
7 ax 


2xy = 


dii/ 


( 2 ) 


Therefore, the differential equation can be written as 


di/f di/r dy 
dx dy dx 


(3) 


Assuming that y is a function of x, we can use the chain rule to write the left side of Eq. (3) as 
di\r{x,y)/dx. Then Eq. (3) has the form 


di/z 

dx 


(x,y) 


d 

dx 


(x 2 + xy 2 ) = 0. 


(4) 


By integrating Eq. (4) we obtain 


i//(x,y) = x 2 + xy 2 = c, 


(5) 


where c is an arbitrary constant. The level curves of i//(x,y) are the integral curves of Eq. (1). 
Solutions of Eq. (1) are defined implicitly by Eq. (5). 


In solving Eq. (1) the key step was the recognition that there is a function xj/ that 
satisfies Eqs. (2). More generally, let the differential equation 

M(x,y)+N(x,y)y' = 0 


( 6 ) 
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Theorem 2.6.1 


be given. Suppose that we can identify a function \/r(x,y) such that 

^-(x,y) = M(x,y), ^~(x,y) = N(x,y), (7) 

ox dy 

and such that \/r(x,y) = c defines y = 0(x) implicitly as a differentiable function 
of v. Then 

, 3 \l/ d\I/ dy d 

M(x,y)+N(x,y)y = + — — = —\lr[x,</>(x)] 

ox dy dx dx 

and the differential equation (6) becomes 

-f^[x,cP(x)] = 0. (8) 

dx 

In this case Eq. (6) is said to be an exact differential equation. Solutions of Eq. (6), 
or the equivalent Eq. (8), are given implicitly by 

VdXy) = c, (9) 


where c is an arbitrary constant. 

In Example 1 it was relatively easy to see that the differential equation was exact 
and, in fact, easy to find its solution, at least implicitly, by recognizing the required 
function \[r. For more complicated equations it may not be possible to do this so 
easily. How can we tell whether a given equation is exact, and if it is, how can we find 
the function \/s(x,y)l The following theorem answers the first question, and its proof 
provides a way of answering the second. 


Let the functions M,N,M y , and N x , where subscripts denote partial derivatives, 
be continuous in the rectangular 17 region R: a < x < /3, y < y < 8. Then Eq. (6) 

M(x,y)+N(x,y)y' = 0 

is an exact differential equation in R if and only if 

M y (x,y) = N x (x,y) (10) 

at each point of R. That is, there exists a function satisfying Eqs. (7), 

^x(x,y) = M(x,y), ^ y (x,y) = N(x,y), 

if and only if M and N satisfy Eq. (10). 


17 It is not essential that the region be rectangular, only that it be simply connected. In two dimensions 
this means that the region has no holes in its interior. Thus, for example, rectangular or circular regions 
are simply connected, but an annular region is not. More details can be found in most books on advanced 
calculus. 
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The proof of this theorem has two parts. First, we show that if there is a function 
i/s such that Eqs. (7) are true, then it follows that Eq. (10) is satisfied. Computing 
M y and N x from Eqs. (7), we obtain 

M y (x,y) = \ls xy (x,y), N x (x,y) = x\r yx (x,y ). (11) 

Since M y and N x are continuous, it follows that xjr xy and \fr yx are also continuous. This 
guarantees their equality, and Eq. (10) is valid. 

We now show that if M and N satisfy Eq. (10), then Eq. (6) is exact. The proof 
involves the construction of a function x// satisfying Eqs. (7) 

f X (x,y ) = M(x,y), 1r y (x,y) = N(x,y). 

We begin by integrating the first of Eqs. (7) with respect to x, holding y constant. We 
obtain 

&(x,y) = Q(x,y) + h(y), (12) 


where Q(x,y) is any differentiable function such that dQ(x,y)/dx = M(x,y). For 
example, we might choose 

Q(x,y)=f M(s,y)ds, (13) 

Jx 0 

where xo is some specified constant in a < xo < The function h in Eq. (12) is an 
arbitrary differentiable function of y, playing the role of the arbitrary constant. Now 
we must show that it is always possible to choose h(y) so that the second of Eqs. (7) 
is satisfied—that is, 4r y = N. By differentiating Eq. (12) with respect to y and setting 
the result equal to N(x,y), we obtain 

fy(x,y) = ^-(x,y) + h'(y) = N(x,y). 
dy 


Then, solving for h'iy), we have 


h'(y) = N(x,y ) - 


9G 

dy 


C X,y ). 


(14) 


In order for us to determine h(y) from Eq. (14), the right side of Eq. (14), despite 
its appearance, must be a function of y only. One way to show that this is true is to 
show that its derivative with respect to x is zero. Thus we differentiate the right side 
of Eq. (14) with respect to x, obtaining 


dN 

dx 


(*,y) 


d_d_Q 
dx dy 


(x,y). 


(15) 


By interchanging the order of differentiation in the second term of Eq. (15), we have 


or, since dQ/dx = M, 


dN 3 dQ 

-x-(*,y) - ^-^-(*,) 0 , 

dx dy dx 


dN d M 

-x~(x,y) - —(x,y), 
dx dy 


which is zero on account of Eq. (10). Hence, despite its apparent form, the right side of 
Eq. (14) does not, in fact, depend on x. Then we find h(y) by integrating Eq. (14), and 
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upon substituting this function in Eq. (12), we obtain the required function \J/(x,y). 
This completes the proof of Theorem 2.6.1. 

It is possible to obtain an explicit expression for \/r(x, y) in terms of integrals (see 
Problem 17), but in solving specific exact equations, it is usually simpler and easier just 
to repeat the procedure used in the preceding proof. That is, integrate \fr x = M with 
respect to x, including an arbitrary function of h(y) instead of an arbitrary constant, 
and then differentiate the result with respect to y and set it equal to N. Finally, use 
this last equation to solve for h(y). The next example illustrates this procedure. 

EXAMPLE 

2 

Solve the differential equation 

(y cosx + 2xe y ) + (sinx + x 2 e y — 1)/ = 0 . (16) 

By calculating M y and N x , we find that 

M y (x,y ) = cos x + 2xe y = N x (x,y ), 

so the given equation is exact. Thus there is a ty(x,y) such that 

i/f x (x,y) = y cosx + 2xe y , 

\ls y (x,y) = sinx + x 2 e y — 1 . 

Integrating the first of these equations, we obtain 

i/r(x,y) = y sinx + x 2 e y + h(y). (17) 

Setting xj/y = N gives 

il/ y (x,y) = sinx + x 2 e y + h'(y) = sinx + x 2 e y — 1 . 

Thus h'(y) = —land h(y) = —y. The constant of integration can be omitted since any solution 
of the preceding differential equation is satisfactory; we do not require the most general one. 
Substituting for h(y) in Eq. (17) gives 

\[f(x,y) = y sinx + x 2 e y — y. 

Hence solutions of Eq. (16) are given implicitly by 

y sinx + x 2 e y — y = c. (18) 

EXAMPLE 

3 

Solve the differential equation 

(3xy + y 2 ) + (x 2 + xy)y' = 0. (19) 

We have 

M y (x,y) = 3x + 2y, N x (x, y) = 2x + y; 

since M y ^ N x , the given equation is not exact. To see that it cannot be solved by the procedure 
described above, let us seek a function \j/ such that 

fx(x,y) = 3 xy + y 2 , f y (x,y ) = x 2 + xy. (20) 

Integrating the first of Eqs. (20) gives 

ty(x,y) = \x 2 y + xy 2 + h(y), (21) 


( 21 ) 
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where h is an arbitrary function of y only. To try to satisfy the second of Eqs. (20), we compute 
\jr y from Eq. (21) and set it equal to N, obtaining 

|x 2 + 2xy + ti(y) = x 2 + xy 


or 

h'(y) = —\x 2 - xy. (22) 

Since the right side of Eq. (22) depends on x as well as y, it is impossible to solve Eq. (22) for 
h(y). Thus there is no \[f(x,y) satisfying both of Eqs. (20). 


Integrating Factors. It is sometimes possible to convert a differential equation that is 
not exact into an exact equation by multiplying the equation by a suitable integrating 
factor. Recall that this is the procedure that we used in solving linear equations in 
Section 2.1. To investigate the possibility of implementing this idea more generally, 
let us multiply the equation 


M(x,y)+N(x,y)y' = 0 (23) 

by a function /z and then try to choose /z so that the resulting equation 

H(x,y)M(x,y ) + n(x,y)N(x,y)y' = 0 (24) 

is exact. By Theorem 2.6.1, Eq. (24) is exact if and only if 

(nM) y = (jiN) x . (25) 

Since M and N are given functions, Eq. (25) states that the integrating factor /x must 
satisfy the first order partial differential equation 


M fly Nfi x + (My N x )f! = 0. (26) 

If a function /z satisfying Eq. (26) can be found, then Eq. (24) will be exact. The 
solution of Eq. (24) can then be obtained by the method described in the first part of 
this section. The solution found in this way also satisfies Eq. (23), since the integrating 
factor fi can be canceled out of Eq. (24). 

A partial differential equation of the form (26) may have more than one solution; 
if this is the case, any such solution may be used as an integrating factor of Eq. (23). 
This possible nonuniqueness of the integrating factor is illustrated in Example 4. 

Unfortunately, Eq. (26), which determines the integrating factor /z, is ordinarily 
at least as hard to solve as the original equation (23). Therefore, although in princi¬ 
ple integrating factors are powerful tools for solving differential equations, in practice 
they can be found only in special cases. The most important situations in which simple 
integrating factors can be found occur when /z is a function of only one of the variables 
x or y, instead of both. 

Let us determine conditions on M and N so that Eq. (23) has an integrating factor 
fi that depends on x only. If we assume that /z is a function of x only, then the partial 
derivative fi x reduces to the ordinary derivative dfi/dx and \i y = 0. Making these 
substitutions in Eq. (26), we find that 

dfi M y — N x 

lx = N 


/z. 


(27) 
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If (M y — N x )/N is a function of x only, then there is an integrating factor \i that also 
depends only on x; further, /x(x) can be found by solving Eq. (27), which is both linear 
and separable. 

A similar procedure can be used to determine a condition under which Eq. (23) 
has an integrating factor depending only on y; see Problem 23. 


EXAMPLE 

4 


Find an integrating factor for the equation 

(3xy + y 2 ) + (x 2 + xy)y' = 0 (19) 


and then solve the equation. 

In Example 3 we showed that this equation is not exact. Let us determine whether it has an 
integrating factor that depends on x only. On computing the quantity (M y — N x ) / N , we find 
that 

M y (x,y) - N x (x,y ) _ 3x + 2 y - (2x + y) 

N{x,y) x 2 +xy 


(28) 


Thus there is an integrating factor /x that is a function of x only, and 
equation 

d/x ji 
dx x 


it satisfies the differential 
(29) 


Hence 

/x(x) = x. (30) 


Multiplying Eq. (19) by this integrating factor, we obtain 

(3x 2 y + xy 2 ) + (x 3 + x 2 y)y' = 0. (31) 


Equation (31) is exact, since 

— (3x 2 y + xy 2 ) = 3x 2 + 2 xy = — (x 3 + x 2 y ). 
dy dx 

Thus there is a function \j/ such that 

f x {x,y) = 3x 2 y + xy 2 , & y (x,y) = x 3 + x 2 y. (32) 

Integrating the first of Eqs. (32), we obtain 

f{x,y) = x 3 y + \x 2 y 2 + h(y). 

Substituting this expression for i/r(x,y) in the second of Eqs. (32), we find that 

x 3 +x 2 y + h’(y) =x 3 +x 2 y, 


so h'{y) = 0 and h(y) is a constant. Thus the solutions of Eq. (31), and hence of Eq. (19), are 
given implicitly by 


x 3 y + \x 2 y 2 = c. 


(33) 


Solutions may also be found in explicit form since Eq. (33) is quadratic in y. 
You may also verify that a second integrating factor for Eq. (19) is 


li{x,y) 


1 

xy(2x + y) 


and that the same solution is obtained, though with much greater difficulty, if this integrating 
factor is used (see Problem 32). 
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PROBLEMS Determine whether each of the equations in Problems 1 through 12 is exact. If it is exact, find 
the solution. 

1. (2x + 3) + (2 y - 2 )/ = 0 
3. (3x 2 - 2 xy + 2) + ( 6 y 2 - x 2 + 3 )y' = 0 
dy ax + by 

dx bx + cy 


2 . ( 2x + 4 y) + (2x — 2y)y / = 0 
4. (2 xy 2 + 2 y) + (2 x 2 y + 2x)y' = 0 
^ dy ax — by 
dx 


bx — cy 


7. ( e x sin y — 2y sin x) + (e* cos y + 2 cos x)y' = 0 

8 . ( e x siny + 3 y) — (3x — e* siny^' = 0 

9. ( y^ y cos 2x — 2e* y sin 2x + 2x) + ( xe xy cos 2x — 3 )y r = 0 
10 . ( y/x + 6x) + (lnx — 2)y' = 0 , x > 0 

(x\ny + xy) + (y \nx + xy)y' = 0 ; x > 0 , 
x y dy 


11 . 

12 . 


y > 0 


+ 


= 0 


(x 2 + y 2 ) 3 / 2 (x 2 + y 2 ) 3 / 2 dx 

In each of Problems 13 and 14, solve the given initial value problem and determine at least 
approximately where the solution is valid. 

13. (2x - y) + (2 y - x)y r = 0, y(l) = 3 

14. (9x 2 + y — 1) — {Ay — x)y' = 0, y(l) = 0 

In each of Problems 15 and 16, find the value of b for which the given equation is exact, and 
then solve it using that value of b. 

15. (xy 2 + bx 2 y) + (x + y)x 2 y' = 0 16. (ye 2xy + x) + bxe 2xy y' = 0 

17. Assume that Eq. ( 6 ) meets the requirements of Theorem 2.6.1 in a rectangle R and is 
therefore exact. Show that a possible function ^r(x, y) is 


: f M(s,y 0 )ds+ f 

Jxo Jyr 


\jr(x,y) = / M(s,yo)ds+ / N(x,t)dt , 


where (x 0 ,yo) is a point in R. 

18. Show that any separable equation 

is also exact. 


M(x) + N(y)y' = 0 


In each of Problems 19 through 22, show that the given equation is not exact but becomes 
exact when multiplied by the given integrating factor. Then solve the equation. 

19. x 2 y 3 +x(l +y 2 )y' = 0, /^(x,y) = 1 /xy 3 


^ /siny ^ . \ /cosy + 2 c x cosx 

20 . (- 2e *sinx I + ' 


)/ = 0 , 


/x(x,y) =yc* 


V y J \ y 

21 . y + ( 2 x — ye y )y' = 0 , l^(x,y) = y 

22 . (x + 2 ) sin y + (x cos y)y' = 0 , /x(x,y)=xc* 

23. Show that if (N x — M y )/M = Q , where Q is a function of y only, then the differential 
equation 

M + Ny' = 0 


has an integrating factor of the form 

ti(y) = exp J Q(y ) dy. 
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24. Show that if ( N x — M y )/(xM — yN) = R , where R depends on the quantity xy only, then 
the differential equation 


M + Ny' = 0 


has an integrating factor of the form /x(xy). Find a general formula for this integrating 
factor. 


In each of Problems 25 through 31, find an integrating factor and solve the given equation. 
25. (3 x 2 y + 2 xy + y 3 ) + (x 2 + y 2 )y' = 0 26. y' = e 2x + y - 1 


27. 1 + (x/y — siny)/ = 0 

29. e x + ( e x coty + 2y cscy)y' = 0 

30. [4 (x 3 /y 2 ) + (3 /y)] + [3 (x/y 2 ) + 4y]y' = 0 


31. 


(3x+-) + (-+3 y -)^=( 
V y) \y xj dx 

Hint: See Problem 24. 

32. Solve the differential equation 


28. y + (2xy - e 2y )y' = 0 


(3xy + y 2 ) + (x 2 + xy)y' = 0 


using the integrating factor n(x,y) = (:v'v(2x + >’)] '. Verify that the solution is the same 
as that obtained in Example 4 with a different integrating factor. 


2.7 Numerical Approximations: Euler’s Method 


Recall two important facts about the first order initial value problem 

^ =f(t,y), y(to)=yo■ ( 1 ) 

First, if / and df/dy are continuous, then the initial value problem (1) has a unique 
solution y = cj)(t) in some interval surrounding the initial point t = to. Second, it is 
usually not possible to find the solution 0 by symbolic manipulations of the differ¬ 
ential equation. Up to now we have considered the main exceptions to the latter 
statement: differential equations that are linear, separable, or exact, or that can be 
transformed into one of these types. Nevertheless, it remains true that solutions of 
the vast majority of first order initial value problems cannot be found by analytical 
means, such as those considered in the first part of this chapter. 

Therefore, it is important to be able to approach the problem in other ways. As we 
have already seen, one of these ways is to draw a direction field for the differential 
equation (which does not involve solving the equation) and then to visualize the 
behavior of solutions from the direction field. This has the advantage of being a 
relatively simple process, even for complicated differential equations. However, it 
does not lend itself to quantitative computations or comparisons, and this is often a 
critical shortcoming. 

For example, Figure 2.7.1 shows a direction field for the differential equation 

^ = 3 - 2 1- 0.5y. 

dt 


( 2 ) 
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From the direction field you can visualize the behavior of solutions on the rectangle 
shown in the figure. On this rectangle a solution starting at a point on the y-axis 
initially increases with t , but it soon reaches a maximum value and then begins to 
decrease as t increases further. 
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FIGURE 2.7.1 A direction field for Eq. (2): dy/dt = 3-2 1- 0.5y. 


You may also observe that in Figure 2.7.1 many tangent line segments at successive 
values of t almost touch each other. It takes only a bit of imagination to consider 
starting at a point on the y-axis and linking line segments for successive values of t in 
the grid, thereby producing a piecewise linear graph. Such a graph would apparently 
be an approximation to a solution of the differential equation. To convert this idea 
into a useful method for generating approximate solutions, we must answer several 
questions, including the following: 

1. Can we carry out the linking of tangent lines in a systematic and straightforward 
manner? 

2. If so, does the resulting piecewise linear function provide an approximation to an actual 
solution of the differential equation? 

3. If so, can we assess the accuracy of the approximation? That is, can we estimate how far 
the approximation deviates from the solution itself? 

It turns out that the answer to each of these questions is affirmative. The resulting 
method was originated by Euler about 1768 and is referred to as the tangent line 
method or the Euler method. We will deal with the first two questions in this section 
but will defer a systematic discussion of the third question until Chapter 8. 

To see how the Euler method works, let us consider how we might use tangent 
lines to approximate the solution y = 0(7) of Eqs. (1) near t = to. We know that the 
solution passes through the initial point (to, yo), and from the differential equation, we 
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also know that its slope at this point isf(to,yo)- Thus we can write down an equation 
for the line tangent to the solution curve at (to,yo), namely, 

y = yo+f(to,yo)(t- to). (3) 

The tangent line is a good approximation to the actual solution curve on an interval 
short enough so that the slope of the solution does not change appreciably from its 
value at the initial point; see Figure 2.7.2. Thus, if t\ is close enough to to, we can 
approximate (j){t\) by the value y\ determined by substituting t — t\ into the tangent 
line approximation at t = to', thus 

y i = yo +f(to,yo)(h - to). (4) 



FIGURE 2.7.2 A tangent line approximation. 


To proceed further, we can try to repeat the process. Unfortunately, we do not know 
the value 0(q) of the solution at t\ . The best we can do is to use the approximate 
value y\ instead. Thus we construct the line through (h,y\) with the slope f(h,y\), 

y = yi+f(h,yi)(t-h). (5) 

To approximate the value of 0(0 at a nearby point h, we use Eq. (5) instead, obtaining 

yi = yi +f(h,yi)(t 2 - to. (6) 

Continuing in this manner, we use the value of y calculated at each step to deter¬ 
mine the slope of the approximation for the next step. The general expression for the 
tangent line starting at (t n ,y n ) is 

y — yn T f (t n ,y n )(t 0 ), (7) 

hence the approximate value y n+ i at t n+ \ in terms of t n , t n+ \ , and y n is 

yn+l = yn T f (ln^yn)(ln-\- 1 0)? ^ = 0, 1 , 2 , ... . (8) 

If we introduce the notation/„ = f(t n ,y n ), then we can rewrite Eq. (8) as 

y n + 1 = y n T f n • (wi - tn), n = 0,1,2,.... (9) 

Finally, if we assume that there is a uniform step size h between the points to,h,t 2 , ..., 
then t n+ 1 = t n + h for each n , and we obtain Euler’s formula in the form 

yn +1 = yn T fnh. 


n = 0,1,2,.... 


( 10 ) 
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To use Euler’s method, you repeatedly evaluate Eq. (9) or Eq. (10), depending on 
whether or not the step size is constant, using the result of each step to execute the 
next step. In this way you generate a sequence of values yi,y 2 ,^ 3 , • • .that approximate 
the values of the solution 0(t) at the points h,t 2 ,t 3 ,.... If, instead of a sequence of 
points, you need a function to approximate the solution 0(t), then you can use the 
piecewise linear function constructed from the collection of tangent line segments. 
That is, let y be given in [to, h\ by Eq. (7) with n = 0, in [q, fe] by Eq. (7) with n = 1, 
and so on. 


Consider the initial value problem 

EXAMPLE 

1 = 3 — 2t — 0.5y, y(0) = 1. (11) 

Use Euler’s method with step size h = 0.2 to find approximate values of the solution of Eqs. (11) 
at t = 0.2,0.4,0.6,0.8, and 1. Compare them with the corresponding values of the actual solution 
of the initial value problem. 

Note that the differential equation in the given initial value problem is the same as in Eq. (2). 
This equation is linear, so it can be solved as in Section 2.1, using the integrating factor e t/2 . 
The resulting solution of the initial value problem (11) is 

y = 0(0 = 14-4 1- 13e~ t/2 . (12) 

To approximate this solution by means of Euler’s method, note that in this case 
f(t,y) = 3 — 21 — 0.5y. Using the initial values 0 = 0 and y 0 = 1, we find that 

fo = ffayo) = /(0,1) = 3 - 0 - 0.5 = 2.5 

and then, from Eq. (3), the tangent line approximation near t = 0 is 

y = l + 2.5(f~0) = l + 2.5f. (13) 

Setting t = 0.2 in Eq. (13), we find the approximate value y\ of the solution at t = 0.2, namely, 

yi = 1 + (2.5) (0.2) = 1.5. 


At the next step we have 

/1 = /(0.2,1.5) = 3 - 2(0.2) - (0.5)(1.5) = 3 - 0.4 - 0.75 = 1.85. 

Then the tangent line approximation near t = 0.2 is 

y = 1.5 + 1.85(f - 0.2) = 1.13 + 1.85f. (14) 

Evaluating the expression in Eq. (14) for t = 0.4, we obtain 

y 2 = 1.13 + 1.85(0.4) = 1.87. 

Repeating this computational procedure three more times, we obtain the results shown in 
Table 2.7.1. 

The first column contains the ^-values separated by the step size h = 0.2. The third 
column shows the corresponding y-values computed from Euler’s formula (10). In the 
fourth column are the tangent line approximations found from Eq. (7). The second column 
contains values of the solution (12) of the initial value problem (11), correct to five decimal 
places. The solution (12) and the tangent line approximation are also plotted in Figure 2.7.3. 

From Table 2.7.1 and Figure 2.7.3 we see that the approximations given by Euler’s method for 
this problem are greater than the corresponding values of the actual solution. This is because 
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the graph of the solution is concave down and therefore the tangent line approximations lie 
above the graph. 

The accuracy of the approximations in this example is not good enough to be satisfactory in 
a typical scientific or engineering application. For example, at t = 1 the error in the approxi¬ 
mation is 2.32363 — 2.11510 = 0.20853, which is a percentage error of about 9.86% relative to 
the exact solution. One way to achieve more accurate results is to use a smaller step size, with 
a corresponding increase in the number of computational steps. We explore this possibility in 
the next example. 


TABLE 2.7.1 Results of Euler’s Method with h = 0.2 for 
y = 3 - It - 0.5y, y( 0) = 1 


t 

Exact 

Euler 

with h = 0.2 


Tangent line 

0.0 

1.00000 

1.00000 

y = 

1 + 2.51 

0.2 

1.43711 

1.50000 

y = 

1.13 + 1.851 

0.4 

1.75650 

1.87000 

y = 

1.364 + 1.265* 

0.6 

1.96936 

2.12300 

y = 

1.6799 + 0.7385* 

0.8 

2.08584 

2.27070 

y = 

2.05898 + 0.26465* 

1.0 

2.11510 

2.32363 




y 

2.4 


2 - 


1.6 - 


1.2 - 


Tangent line approximation 


Solution 


0.2 0.4 0.6 0.8 1 t 

FIGURE 2.7.3 Plots of the solution and a tangent line approximation 
with h = 0.2 for the initial value problem (11): dy/dt = 3 — 21 — 0.5y, y(0) = 1. 


Of course, computations such as those in Example 1 and in the other examples in 
this section are usually done on a computer. Some software packages include code 
for the Euler method, while others do not. In any case, it is straightforward to write 
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a computer program that will carry out the calculations required to produce results 
such as those in Table 2.7.1. Basically, what is required is a loop that will evaluate 
Eq. (10) repetitively, along with suitable instructions for input and output. The output 
can be a list of numbers, as in Table 2.7.1, or a plot, as in Figure 2.7.3. The specific 
instructions can be written in any high-level programming language with which you 
are familiar. 


Consider again the initial value problem (11) 

EXAMPLE 

2 ^=3-2;-0.5y, y(0) = 1. 

Use Euler’s method with various step sizes to calculate approximate values of the solution 
for 0 < t < 5. Compare the calculated results with the corresponding values of the exact 
solution (12) 

y = (p{t) = 14 — 4 1 — \3e~ t/2 . 

We used step sizes h = 0.1,0.05,0.025, and 0.01, corresponding respectively to 50,100,200, 
and 500 steps, to go from t = 0 to t = 5. The results of these calculations, along with the values 
of the exact solution, are presented in Table 2.7.2. All computed entries are rounded to four 
decimal places, although more digits were retained in the intermediate calculations. 


TABLE 2.7.2 A Comparison of Exact Solution with Euler’s Method for Several 
Step Sizes h for / = 3 - 2t - 0.5y, y(0) = 1 


t 

Exact 

;s- 

II 

p 

h = 0.05 

h = 0.025 

h = 0.01 

0.0 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0 

2.1151 

2.2164 

2.1651 

2.1399 

2.1250 

2.0 

1.2176 

1.3397 

1.2780 

1.2476 

1.2295 

3.0 

-0.9007 

-0.7903 

-0.8459 

-0.8734 

-0.8898 

4.0 

-3.7594 

-3.6707 

-3.7152 

-3.7373 

-3.7506 

5.0 

-7.0671 

-7.0003 

-7.0337 

-7.0504 

-7.0604 


What conclusions can we draw from the data in Table 2.7.2? The most important observation 
is that, for a fixed value of t , the computed approximate values become more accurate as the 
step size h decreases. You can see this by reading across a particular row in the table from left 
to right. This is what we would expect, of course, but it is encouraging that the data confirm our 
expectations. For example, for t = 2 the approximate value with h = 0.1 is too large by 0.1221 
(about 10%), whereas the value with h = 0.01 is too large by only 0.0119 (about 1%). In this 
case, reducing the step size by a factor of 10 (and performing 10 times as many computations) 
also reduces the error by a factor of about 10. By comparing the errors for other pairs of 
values in the table, you can verify that this relation between step size and error holds for them 
also: reducing the step size by a given factor also reduces the error by approximately the same 
factor. Does this mean that for the Euler method the error is approximately proportional to 
the step size? Of course, one example does not establish such a general result, but it is at least 
an interesting conjecture. 18 


18 A more detailed discussion of the errors in using the Euler method appears in Chapter 8. 
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A second observation from Table 2.7.2 is that, for a fixed step size h, the approximations 
become more accurate as t increases, at least for t > 2. For instance, for h = 0.1 the error for 
t = 5 is only 0.0668, which is a little more than one-half of the error at t = 2. We will return to 
this matter later in this section. 

All in all, Euler’s method seems to work rather well for this problem. Reasonably good 
results are obtained even for a moderately large step size h = 0.1, and the approximation can 
be improved by decreasing h. 


Let us now look at another example. 


Consider the initial value problem 

EXAMPLE 

3 $=4-f + 2 y, y(0) = 1 . (15) 

at 

The general solution of this differential equation was found in Example 2 of Section 2.1, and 
the solution of the initial value problem (15) is 

y = -l + \t+ l ie 2 '. (16) 

Use Euler’s method with several step sizes to find approximate values of the solution on the 
interval 0 < t < 5. Compare the results with the corresponding values of the solution (16). 

Using the same range of step sizes as in Example 2, we obtain the results presented in 
Table 2.7.3. 


TABLE 2.7.3 A Comparison of Exact Solution with Euler’s Method for Several Step Sizes h 


for y' 

= 4-t + 2y, >-(0) 

= 1 




t 

Exact 

t-H 

o 

II 

h = 0.05 

h = 0.025 

h = 0.01 

0.0 

1.000000 

1.000000 

1.000000 

1.000000 

1.000000 

1.0 

19.06990 

15.77728 

17.25062 

18.10997 

18.67278 

2.0 

149.3949 

104.6784 

123.7130 

135.5440 

143.5835 

3.0 

1109.179 

652.5349 

837.0745 

959.2580 

1045.395 

4.0 

8197.884 

4042.122 

5633.351 

6755.175 

7575.577 

5.0 

60573.53 

25026.95 

37897.43 

47555.35 

54881.32 


The data in Table 2.7.3 again confirm our expectation that, for a given value of t, accuracy 
improves as the step size h is reduced. For example, for t = 1 the percentage error diminishes 
from 17.3% when h = 0.1 to 2.1% when h = 0.01. However, the error increases fairly rapidly as 
t increases for a fixed h. Even for h = 0.01, the error at t = 5 is 9.4%, and it is much greater for 
larger step sizes. Of course, the accuracy that is needed depends on the purpose for which the 
results are intended, but the errors in Table 2.7.3 are too large for most scientific or engineering 
applications. To improve the situation, we might either try even smaller step sizes or else restrict 
the computations to a rather short interval away from the initial point. Nevertheless, it is clear 
that Euler’s method is much less effective in this example than in Example 2. 
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To understand better what is happening in these examples, let us look again at 
Euler’s method for the general initial value problem (1) 

dy 

— = f(t,y ), y(t 0 ) =yo, 

whose solution we denote by 0(t). Recall that a first order differential equation has 
an infinite family of solutions, indexed by an arbitrary constant c, and that the initial 
condition picks out one member of this infinite family by determining the value of c. 
Thus in the infinite family of solutions, 0(0 is the one that satisfies the initial condition 

0 ( 0 ) = yo- 

At the first step Euler’s method uses the tangent line approximation to the graph 
of y = 0(0 passing through the initial point (to,y o), and this produces the approx¬ 
imate value yi at t\. Usually y\ ^ 0(0), so at the second step Euler’s method uses 
the tangent line approximation not to y — 0(0, but to a nearby solution y = 0i(O 
that passes through the point (0,yi). So it is at each subsequent step. Euler’s method 
uses a succession of tangent line approximations to a sequence of different solutions 
0(0,0i(0,02(0,... of the differential equation. At each step the tangent line is con¬ 
structed to the solution passing through the point determined by the result of the 
preceding step, as shown in Figure 2.7.4. The quality of the approximation after many 
steps depends strongly on the behavior of the set of solutions that pass through the 
points (t n ,y n ) for n = 1,2,3,.... 



In Example 2 the general solution of the differential equation is 

y = 14 - At + ce~ t/2 (17) 

and the solution of the initial value problem (11) corresponds to c = —13. The family 
of solutions (17) is a converging family since the term involving the arbitrary constant 
c approaches zero as t -> oo. It does not matter very much which solutions we are 
approximating by tangent lines in the implementation of Euler’s method, since all 
the solutions are getting closer and closer to each other as t increases. 
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On the other hand, in Example 3 the general solution of the differential equation is 

y = — \ + \t + ce 2 \ (18) 

and this is a diverging family. Note that solutions corresponding to two nearby values 
of c become arbitrarily far apart as t increases. In Example 3 we are trying to follow 
the solution for c = 11/4, but in the use of Euler’s method we are actually at each 
step following another solution that separates from the desired one faster and faster 
as t increases. This explains why the errors in Example 3 are so much larger than 
those in Example 2. 

In using a numerical procedure such as the Euler method, you must always keep 
in mind the question of whether the results are accurate enough to be useful. In 
the preceding examples, the accuracy of the numerical results could be determined 
directly by a comparison with the solution obtained analytically. Of course, usually 
the analytical solution is not available if a numerical procedure is to be employed, so 
what we usually need are bounds for, or at least estimates of, the error that do not 
require a knowledge of the exact solution. You should also keep in mind that the best 
that we can expect, or hope for, from a numerical approximation is that it reflects 
the behavior of the actual solution. Thus a member of a diverging family of solutions 
will always be harder to approximate than a member of a converging family. 

If you wish to read more about numerical approximations to solutions of initial 
value problems, you may go directly to Chapter 8 at this point. There we present 
some information on the analysis of errors and also discuss several algorithms that 
are computationally much more efficient than the Euler method. 


PROBLEMS Most of the problems in this section call for fairly extensive numerical computations. To han- 
die these problems you need suitable computing hardware and software. Keep in mind that 
numerical results may vary somewhat, depending on how your program is constructed and on 
how your computer executes arithmetic steps, rounds off, and so forth. Minor variations in the 
last decimal place may be due to such causes and do not necessarily indicate that something is 
amiss. Answers in the back of the book are recorded to six digits in most cases, although more 
digits were retained in the intermediate calculations. 


In each of Problems 1 through 4: 

(a) Find approximate values of the solution of the given initial value problem at t = 0.1,0.2, 
0.3, and 0.4 using the Euler method with h = 0.1. 

(b) Repeat part (a) with h = 0.05. Compare the results with those found in (a). 

(c) Repeat part (a) with h = 0.025. Compare the results with those found in (a) and (b). 

(d) Find the solution y = <f>(t) of the given problem and evaluate 0(f) at t = 0.1,0.2, 0.3, and 
0.4. Compare these values with the results of (a), (b), and (c). 

4fl l.y’ = 3 + t-y, y(0) = l 2.y’ = 2y-\, y(0) = 1 

ffl, 3. y' = 0.5 — t + 2y, y(0) = 1 4. y' = 3 cos t — 2y, ^(0) = 0 

In each of Problems 5 through 10, draw a direction field for the given differential equation 
and state whether you think that the solutions are converging or diverging. 

5. y = 5 - 3 yy jfl, 6. y = y( 3 - ty) 

jfb 7. y = (4 - 00/(1 +y 2 ) 8. y = -ty + 0.1 v 3 

jfh 9. y = t 2 + y 2 10. y' = (y 2 + 2ty)/(3 + t 2 ) 
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In each of Problems 11 through 14, use I 
solution of the given initial value problem 

(a) With h = 0.1. 

(c) With h = 0.025. 
flu. / = 5- 3 Jy, y(0) = 2 
fl 13. / = (4 - ty)/( 1 + y 2 ), y( 0) = -2 

15. Consider the initial value problem 

/ = 3 t 2 /C 


ier’s method to find approximate values of the 
t = 0.5,1,1.5,2,2.5, and 3: 

(b) With h = 0.05. 

(d) With h = 0.01. 

fl 12. y = y (3 - ty), y(0) = 0.5 

fl 14. y = -ty + O.ly 3 , y(0) = 1 

’ 2 — 4), y(l) = 0. 


(a) Use Euler’s method with h — 0.1 to obtain approximate values of the solution at 
t = 1.2,1.4,1.6, and 1.8. 

(b) Repeat part (a) with h = 0.05. 

(c) Compare the results of parts (a) and (b). Note that they are reasonably close for 
t = 1.2, 1.4, and 1.6 but are quite different for t = 1.8. Also note (from the differ¬ 
ential equation) that the line tangent to the solution is parallel to the y-axis when 
y = ±2/V3 = ±1.155. Explain how this might cause such a difference in the calculated 
values. 

16. Consider the initial value problem 

y' = t 2 + y 2 , y(0) = 1. 


Use Euler’s method with h = 0.1, 0.05, 0.025, and 0.01 to explore the solution of this 
problem for 0 < t < 1. What is your best estimate of the value of the solution at t = 0.8? 
At t = 1? Are your results consistent with the direction field in Problem 9? 

17. Consider the initial value problem 

y = (y 2 + 2ty)/(3 + t 2 ), y( 1) = 2. 

Use Euler’s method with h = 0.1, 0.05, 0.025, and 0.01 to explore the solution of this 
problem for 1 < t < 3. What is your best estimate of the value of the solution at t = 2.5? 
At t = 3? Are your results consistent with the direction field in Problem 10? 

18. Consider the initial value problem 

y — —ty ± O.ly 3 , y(0) = a , 


where a is a given number. 

(a) Draw a direction field for the differential equation (or reexamine the one from Prob¬ 
lem 8). Observe that there is a critical value of a in the interval 2 < a < 3 that separates 
converging solutions from diverging ones. Call this critical value ao. 

(b) Use Euler’s method with h = 0.01 to estimate a 0 . Do this by restricting ocq to an interval 
[a, b], where b — a = 0.01. 

19. Consider the initial value problem 

y =y 2 -1 2 , y(0) = a, 

where a is a given number. 

(a) Draw a direction field for the differential equation. Observe that there is a critical 
value of a in the interval 0 < a < 1 that separates converging solutions from diverging 
ones. Call this critical value a 0 . 

(b) Use Euler’s method with h = 0.01 to estimate a 0 . Do this by restricting to an interval 
[a, b], where b — a = 0.01. 
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20. Convergence of Euler’s Method. It can be shown that under suitable conditions on /, 
the numerical approximation generated by the Euler method for the initial value problem 
y' = f(t,y ), y(to) = yo converges to the exact solution as the step size h decreases. This is 
illustrated by the following example. Consider the initial value problem 

/ = 1 -t + y, y(t 0 ) = yo. 

(a) Show that the exact solution is y = <j>(f) = (y 0 — + t. 

(b) Using the Euler formula, show that 

yk = (1 + h)y k - 1 +h- ht k -u k = 1 , 2 ,.... 

(c) Noting that yi = (1 + h)(y 0 — to) + t \, show by induction that 

y n = (l + h) n (yo-to) + t n (i) 


for each positive integer n. 

(d) Consider a fixed point t > to and for a given n choose h = (t — t 0 )/n. Then t n = t for 
every n. Note also that h 0 as n oo. By substituting for h in Eq. (i) and letting n -> oo, 
show that y n 0(0 as n oo. 

Hint: lim (1 + a/ri) n = e a . 

n—>oo 

In each of Problems 21 through 23, use the technique discussed in Problem 20 to show that 
the approximation obtained by the Euler method converges to the exact solution at any fixed 
point as h 0. 

21. y=y, y(0) = 1 

22. y f — 2y — 1, y(0) = 1 Hint:yi = (1 + 2h)/2 + 1/2 

23. / = |—f + 2 y, y(0) = 1 Hint:y\ = (1 + 2 h) + t\/2 


2.8 The Existence and Uniqueness Theorem 


In this section we discuss the proof of Theorem 2.4.2, the fundamental existence and 
uniqueness theorem for first order initial value problems. This theorem states that 
under certain conditions on f(t,y), the initial value problem 

y'=f(t,y), y(t 0 )=y 0 (l) 

has a unique solution in some interval containing the point to. 

In some cases (for example, if the differential equation is linear) the existence 
of a solution of the initial value problem (1) can be established directly by actually 
solving the problem and exhibiting a formula for the solution. However, in general, 
this approach is not feasible because there is no method of solving the differential 
equation that applies in all cases. Therefore, for the general case, it is necessary to 
adopt an indirect approach that demonstrates the existence of a solution of Eqs. (1) 
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but usually does not provide a practical means of finding it. The heart of this method 
is the construction of a sequence of functions that converges to a limit function sat¬ 
isfying the initial value problem, although the members of the sequence individually 
do not. As a rule, it is impossible to compute explicitly more than a few members 
of the sequence; therefore, the limit function can be determined only in rare cases. 
Nevertheless, under the restrictions on f(t,y) stated in Theorem 2.4.2, it is possible 
to show that the sequence in question converges and that the limit function has the 
desired properties. The argument is fairly intricate and depends, in part, on techniques 
and results that are usually encountered for the first time in a course on advanced 
calculus. Consequently, we do not go into all the details of the proof here; we do, 
however, indicate its main features and point out some of the difficulties that must 
be overcome. 

First of all, we note that it is sufficient to consider the problem in which the initial 
point (to,yo) is the origin; that is, we consider the problem 


/ =f(t,y), y( 0) = 0. 


( 2 ) 


If some other initial point is given, then we can always make a preliminary change 
of variables, corresponding to a translation of the coordinate axes, that will take the 
given point (to,yo) into the origin. The existence and uniqueness theorem can now 
be stated in the following way. 


Theorem 2.8.1 Iff and df/dy are continuous in a rectangle R: \t\ < a , \y\ < b , then there is some 


interval \t\ < h < a in which there exists a unique solution y = 0(t) of the initial 
value problem (2). 


For the method of proof discussed here it is necessary to transform the initial value 
problem (2) into a more convenient form. If we suppose temporarily that there is a 
differentiable function y = 0(t) that satisfies the initial value problem, then/[t, <f>(t)] 
is a continuous function of t only. Hence we can integrate y' = f(t,y ) from the initial 
point t = 0 to an arbitrary value of t, obtaining 



(3) 


where we have made use of the initial condition 0(0) = 0. We also denote the dummy 
variable of integration by s. 

Since Eq. (3) contains an integral of the unknown function 0, it is called an integral 
equation. This integral equation is not a formula for the solution of the initial value 
problem, but it does provide another relation satisfied by any solution of Eqs. (2). 
Conversely, suppose that there is a continuous function y = 0(t) that satisfies the 
integral equation (3); then this function also satisfies the initial value problem (2). To 
show this, we first substitute zero for t in Eq. (3), which shows that the initial condition 
is satisfied. Further, since the integrand in Eq. (3) is continuous, it follows from the 
fundamental theorem of calculus that 0 is differentiable and that 0'(f) = f[t,<p(t)]. 
Therefore, the initial value problem and the integral equation are equivalent in the 
sense that any solution of one is also a solution of the other. It is more convenient 
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to show that there is a unique solution of the integral equation in a certain interval 
\t | <h. The same conclusion will then hold also for the initial value problem. 

One method of showing that the integral equation (3) has a unique solution is 
known as the method of successive approximations or Picard’s 19 iteration method. 
In using this method, we start by choosing an initial function 0o, either arbitrarily or 
to approximate in some way the solution of the initial value problem. The simplest 
choice is 

0o (0 = 0; (4) 

then 0o at least satisfies the initial condition in Eqs. (2), although presumably not the 
differential equation. The next approximation 0 1 is obtained by substituting <f>o(s) for 
0(s) in the right side of Eq. (3) and calling the result of this operation 0i(O- Thus 

0i (0 = f f[s,Ms)]ds. (5) 

Jo 

Similarly, 0 2 is obtained from 0i: 

02(0= f f[s,<fa(s)]ds, (6) 

Jo 

and, in general, 

0 / 1+1 (0 = f fMn(s)]ds. ( 7 ) 

Jo 

In this manner we generate the sequence of functions {0 n } = {0o, 0i, 02 ? • • •, 0«> ■ • 
Each member of the sequence satisfies the initial condition, but in general none sat¬ 
isfies the differential equation. However, if at some stage, say, for n = k, we find that 
cf) k+1 ( t ) = fait), then it follows that <fik is a solution of the integral equation (3). Hence 
0£ is also a solution of the initial value problem (2), and the sequence is terminated 
at this point. In general, this does not occur, and it is necessary to consider the entire 
infinite sequence. 

To establish Theorem 2.8.1, we must answer four principal questions: 

1. Do all members of the sequence {(p n ] exist, or may the process break down at some stage? 

2. Does the sequence converge? 

3. What are the properties of the limit function? In particular, does it satisfy the integral 
equation (3) and hence the initial value problem (2)? 

4 . Is this the only solution, or may there be others? 

We first show how these questions can be answered in a specific and relatively simple 
example and then comment on some of the difficulties that may be encountered in 
the general case. 


19 Charles-Emile Picard (1856-1914) was appointed professor at the Sorbonne before the age of 30. Except 
for Henri Poincare, he is perhaps the most distinguished French mathematician of his generation. He 
is known for important theorems in complex variables and algebraic geometry as well as differential 
equations. A special case of the method of successive approximations was first published by Liouville 
in 1838. However, the method is usually credited to Picard, who established it in a general and widely 
applicable form in a series of papers beginning in 1890. 
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EXAMPLE 

1 


Solve the initial value problem 


/ = 2t(l+y), y(P) = o 

by the method of successive approximations. 

Note first that if y = 0(0, then the corresponding integral equation is 

0(0 — f 2s[l + 0(0] ds. 

Jo 

If the initial approximation is 0 o (O = 0, it follows that 


l 


0i(O = / 2s[l + 0o(O] ds — J 2sds = t 2 


Similarly, 


and 


f 


0 2 (0 = / 2s [1 + 0i (0] ds = I 2s[l + s 2 ] ds = t 2 + 




<h(f) = 2s[l + <fc(s)] ds = f o 2s |^1 + 5,2 + y j 
Equations (10), (11), and (12) suggest that 


, 2 r r 

* -* + 2 + 2 ^ 


0n ( 0 — t 2 + — + — + ••• H- - 


( 8 ) 

(9) 

( 10 ) 

( 11 ) 

( 12 ) 

(13) 


2! 3! ' ' n! 

for each n > 1, and this result can be established by mathematical induction, as follows. Equa¬ 
tion (13) is certainly true for n = 1; see Eq. (10). We must show that if it is true for n = k, then 
it also holds for n = k + 1. We have 


l 


4>k+\(t) = / 2v[ 1 J rC f >k (s)]ds 


“i K + 2! + "' + l! 

2 t 4 t 6 r 2fc+2 

+ 2! + 3! + "' + 


(Jt + 1)! ’ 


(14) 


and the inductive proof is complete. 

A plot of the first four iterates, 0i(O, 02(0, 03(0, and 04(0, is shown in Figure 2.8.1. As k 
increases, the iterates seem to remain close over a gradually increasing interval, suggesting 
eventual convergence to a limit function. 

It follows from Eq. (13) that 0 n (O is the nth partial sum of the infinite series 


00 f 2k 

Y — 

^ k\ 


(15) 


hence lim 0 n (O exists if and only if the series (15) converges. Applying the ratio test, we see 

n—>oo 


that, for each t, 


t 2k+ 2 k\ 

(fc + l)! 


t 2 

k +1 


0 as k —> oo. 


(16) 


Thus the series (15) converges for all t, and its sum 0(0 is the limit of the sequence {0„(O}. 
Further, since the series (15) is a Taylor series, it can be differentiated or integrated term by 
term as long as t remains within the interval of convergence, which in this case is the entire 

oo 

t-axis. Therefore, we can verify by direct computation that 0(0 = J2 t 2k /k\ is a solution of the 

k=t 

integral equation (9). Alternatively, by substituting 0(0 for y in Eqs. (8), we can verify that this 
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FIGURE 2.8.1 Plots of the first four Picard iterates 
0i(0,... ,04(0 for Example 1: dy/dt = 2t(l +y ), y(0) = 0. 


function satisfies the initial value problem. In this example it is also possible, from the series 
(15), to identify 0 in terms of elementary functions, namely, 0(0 = e f2 — 1. However, this is not 
necessary for the discussion of existence and uniqueness. 

Explicit knowledge of 0 (0 does make it possible to visualize the convergence of the sequence 
of iterates more clearly by plotting 0(0 — 0&(0 for various values of k. Figure 2.8.2 shows 
this difference for k = 1,2,3,4. This figure clearly shows the gradually increasing interval 
over which successive iterates provide a good approximation to the solution of the initial value 
problem. 



FIGURE 2.8.2 Plots of 0(0 — 0^(0 for Example 1 for k = 1,..., 4. 

Finally, to deal with the question of uniqueness, let us suppose that the initial value problem 
has two different solutions 0 and 0. Since 0 and 0 both satisfy the integral equation (9), we 
have by subtraction that 

0(0 — 0(0 = f 2 s[(/)(s) — 0(0] ds. 

Jo 
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Taking absolute values of both sides, we have, if t > 0, 


1/ 


m)-m\ = \ / 2 s[<p(s)-f(s)]ds 


<-f 


2s |0 (s') — 0(s)| ds. 


If we restrict t to lie in the interval 0 < t < A/2, where A is arbitrary, then 2 1 < A and 


10(0 - 0(01 < A [ 10(s) - 0(S)| ds for 0 < t < A/ 2. (17) 

Jo 

It is now convenient to introduce the function U defined by 

1/(0= [ \<Ks)-xKs)\ds. (18) 

Jo 

Then it follows at once that 

1 /( 0 ) = 0 , 

U (0 >0, for t > 0 
Further, U is differentiable, and U'(t) = |0(O - 0(01- Hence, by Eq. (17), 

U'(t) - AU(t) <0 for 0 < t < A/2. (21) 

Multiplying Eq. (21) by the positive quantity e~ At gives 

[e~ At U(t)]' <0 for 0 < t < A/l. (22) 

Then, upon integrating Eq. (22) from zero to t and using Eq. (19), we obtain 

e~ At U(t) <0 for 0 < t < A/2. 

Hence U(t) < 0 for 0 < t < A/2. However, since A is arbitrary, we conclude that U(t) <0 for 
all nonnegative t. This result and Eq. (20) are compatible only if U it) = 0 for each t > 0. Thus 
U'(t) = 0 and therefore 0(0 = 0(0 for all t > 0. This contradicts the hypothesis that 0 and 0 
are two different solutions. Consequently, there cannot be two different solutions of the initial 
value problem for t > 0. A slight modification of this argument leads to the same conclusion 
for t < 0. 


(19) 

( 20 ) 


Returning now to the general problem of solving the integral equation (3), let us 
consider briefly each of the questions raised earlier: 

1. Do all members of the sequence {0 n } exist? 

In the example, / and df/dy were continuous in the whole ty-plane, and each member 
of the sequence could be explicitly calculated. In contrast, in the general case,/ and df/dy 
are assumed to be continuous only in the rectangle R: \t\ < a , \y\ < b (see Figure 2.8.3). 
Furthermore, the members of the sequence cannot as a rule be explicitly determined. The 
danger is that at some stage, say, for n = k, the graph of y = (f>k(t) may contain points 
that lie outside the rectangle R. More precisely, in the computation of 0&+i(O it would be 
necessary to evaluate f(t,y ) at points where it is not known to be continuous or even to 
exist. Thus the calculation of 0&+i (t) might be impossible. 

To avoid this danger, it may be necessary to restrict t to a smaller interval than \t\ < a. 
To find such an interval, we make use of the fact that a continuous function on a closed 
bounded region is bounded. Hence / is bounded on R ; thus there exists a positive number 
M such that 




(i t,y ) in R. 


(23) 
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We have mentioned before that 

MO) = 0 

for each n. Since/[t, <fc(0] is equal to (/>' k+1 (t), the maximum absolute slope of the graph of 
the equation y = <pk+x(t) is M. Since this graph contains the point (0,0), it must lie in 
the wedge-shaped shaded region in Figure 2.8.4. Hence the point [t, (frk+xiO] remains 
in R at least as long as R contains the wedge-shaped region, which is for \t\ < b/M. We 
hereafter consider only the rectangle D:\t\ < h,\y\ < b, where h is equal either to a or to 
b/M, whichever is smaller. With this restriction, all members of the sequence {<p n (t)} exist. 
Note that whenever b/M < a, you can try to obtain a larger value of h by finding a better 
(that is, smaller) bound M for \f(t,y)\, if this is possible. 


y > 

{-a, b ) 

(a, b ) 



R 





\ 

[-a, 

-b) 

(a, 

-b) 


FIGURE 2.8.3 Region of definition for Theorem 2.8.1. 



FIGURE 2.8.4 Regions in which successive iterates lie. (a) b/M < a; (b) b/M > a. 

2. Does the sequence {</> n (t)} converge? 

We can identify <p n (t) — 0i(t) + [0 2 (O - 0i(O] H-t- [0„(O - 0 n -i(O] as the nih par¬ 

tial sum of the series 

oo 

+ (24) 

k =1 

The convergence of the sequence {0 n (O} is established by showing that the series (24) 
converges. To do this, it is necessary to estimate the magnitude |0&+i(O — <pk (01 of the 
general term. The argument by which this is done is indicated in Problems 15 through 
18 and will be omitted here. Assuming that the sequence converges, we denote the limit 
function by 0, so that 

4>(t) = lim 4> n (t). (25) 

► OO 

3. What are the properties of the limit function 0? 

In the first place, we would like to know that 0 is continuous. This is not, however, a 
necessary consequence of the convergence of the sequence {0„ (0}, even though each mem¬ 
ber of the sequence is itself continuous. Sometimes a sequence of continuous functions 
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converges to a limit function that is discontinuous. A simple example of this phenomenon 
is given in Problem 13. One way to show that 0 is continuous is to show not only that the 
sequence {0„} converges, but also that it converges in a certain manner, known as uniform 
convergence. We do not take up this matter here but note only that the argument referred 
to in the discussion of question 2 is sufficient to establish the uniform convergence of the 
sequence {0„} and, hence, the continuity of the limit function 0 in the interval \t\ < h. 

Now let us return to Eq. (7) 


0n+l(O= / f[s,4>n(s)\ds. 
Jo 

Allowing n to approach oo on both sides, we obtain 

0(0 = lim f f[s,(p n (s)]ds. 
Jo 


(26) 


We would like to interchange the operations of integrating and taking the limit on the 
right side of Eq. (26) so as to obtain 


0(0 = [ lim f[s,Ms)]ds. (27) 

Jo n ^°° 

In general, such an interchange is not permissible (see Problem 14, for example), but once 
again, the fact that the sequence {0 n (Ol converges uniformly is sufficient to allow us to 
take the limiting operation inside the integral sign. Next, we wish to take the limit inside 
the function /, which would give 

4>(t)= f f[s, lim 4>„(s)] ds (28) 

Jo n ^°° 

and hence 

0(0 = [ /fs, 0(0] ds. (29) 

Jo 


The statement that 


lim f[s,(p n (s)] — f[s, lim <f>„(s)] 

n—>oo n—>oo 

is equivalent to the statement that / is continuous in its second variable, which is known by 
hypothesis. Hence Eq. (29) is valid, and the function 0 satisfies the integral equation (3). 
Thus 0 is also a solution of the initial value problem (2). 

4 . Are there other solutions of the integral equation (3) besides y = 0(0? 

To show the uniqueness of the solution y = 0 (0, we can proceed much as in the example. 
First, assume the existence of another solution y = 0(0- It is then possible to show (see 
Problem 19) that the difference 0(0 — 0(0 satisfies the inequality 

10(0 - 0(01 < A f 10(0 - 0(5)1 ds (30) 

Jo 

for 0 < t < h and a suitable positive number A. From this point the argument is identical 
to that given in the example, and we conclude that there is no solution of the initial value 
problem (2) other than the one generated by the method of successive approximations. 
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PROBLEMS In each of Problems 1 and 2, transform the given initial value problem into an equivalent 
problem with the initial point at the origin. 

1. dy/dt = t 2 + y 2 , y( 1) =2 2. dy/dt = 1 — y 3 , y(— 1) = 3 

In each of Problems 3 through 6, let <p 0 (t) = 0 and define {(p n (0] by the method of succes¬ 
sive approximations 

(a) Determine p n (t) for an arbitrary value of n. 

(b) Plot (j) n {t) for n = 1,..., 4. Observe whether the iterates appear to be converging. 

(c) Express lim p n (t) = pit) in terms of elementary functions; that is, solve the given initial 

n—>oo 

value problem. 

(d) Plot |0(O — (p n (01 for n — 1,... ,4. For each of pi(t), • • • ,04(0, estimate the interval in 
which it is a reasonably good approximation to the actual solution. 

01 3. y = 2(y + 1), y(0) = 0 01 4. / =-y - 1, y( 0) = 0 

01 5. y = -y/2 +t, y(0) = 0 01 6. y = y + 1 - t, y((Y) = 0 

In each of Problems 7 and 8, let 0 o (O = 0 and use the method of successive approximations to 
solve the given initial value problem. 

(a) Determine p n (t) for an arbitrary value of n. 

(b) Plot 0 n (O for n = 1,..., 4. Observe whether the iterates appear to be converging. 

(c) Show that the sequence {0 n (O} converges. 

4fb 7. y = ty +1, y(0) = 0 ^ 8. y’ = t 2 y -1, v(0) = 0 

In each of Problems 9 and 10, let 0 o (O = 0 and use the method of successive approximations 
to approximate the solution of the given initial value problem. 

(a) Calculate 0i (t ),..., 0 3 (t ). 

(b) Plot 0i (0,. • •, 03 (0 and observe whether the iterates appear to be converging. 

01 9. y’ = t 2 +y 2 , y(0) = 0 01 W. y' = l-y 3 , y(0) = 0 

In each of Problems 11 and 12, let 0 o (O = 0 and use the method of successive approximations 
to approximate the solution of the given initial value problem. 

(a) Calculate 4>\(t), ...,0 4 (t), or (if necessary) Taylor approximations to these iterates. Keep 
terms up to order six. 

(b) Plot the functions you found in part (a) and observe whether they appear to be converging. 

01 11. y = - siny + 1, }'(0) =0 01 12. / = (3 1 2 + 4 1 + 2)/2 (y - 1), y(0) = 0 

13. Let pnix) = x n for 0 < x < 1 and show that 


lim 4> n {x) = 

n—>oo 


0 < x < 1, 

X = 1 . 


This example shows that a sequence of continuous functions may converge to a limit 
function that is discontinuous. 

14. Consider the sequence 0„(x) = 2 nxe~ nx2 , 0 < x < 1. 

(a) Show that lim 0 n (x) = 0 for 0 < x < 1; hence 

n—> oo 


f 

Jo 


lim 0„(x) <ix = 0. 

n—> oo 
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(b) Show that / 2 nxe nx2 dx = 1 - e n \ hence 
Jo 

lim / (p n (x)dx = 1 . 

n ^°° J() 

Thus, in this example, 

nb nb 

lim / cj) n {x)dx^ / lim (\> n {x)dx, 
n ^°° Ja Ja n ^°° 

even though lim cp n (x) exists and is continuous. 


In Problems 15 through 18, we indicate how to prove that the sequence {0„(O}> defined by 
Eqs. (4) through (7), converges. 

15. If df/dy is continuous in the rectangle D , show that there is a positive constant K such that 

\f(t,yO 2)1 £ K\yi -y 2 \, (i) 

where (t, y{) and (t, y 2 ) are any two points in D having the same t coordinate. This inequality 
is known as a Lipschitz 20 condition. 

Hint: Hold t fixed and use the mean value theorem on / as a function of y only. Choose K 
to be the maximum value of \df/dy\ in D. 

16. If (pn-i(t) and <p n (t) are members of the sequence {</> n (t)}, use the result of Problem 15 to 
show that 

< k\m t) - fa-m. 


17. (a) Show that if \t\ <h, then 


\M0\ <M\t\, 


where M is chosen so that \f(t,y)\ < M for (t,y) in D. 

(b) Use the results of Problem 16 and part (a) of Problem 17 to show that 

MK\t\ 2 

102 ( 0 - 01(01 < 


(c) Show, by mathematical induction, that 


MK n ~ l \t\ n MK n ~ l h n 

l0n(O 0n—l(0l < -— < 


18. Note that 


n\ 


n\ 


0n(0 — 01 (0 + [02(0 “ 01 (0] + • • • + [0n(O — 0n-l(OL 


(a) Show that 


I0n (0 I < |0l(OI + l02(O -01 (01 + 

(b) Use the results of Problem 17 to show that 

M 


10n (01 < 


K 


K, + ^ + 


+ |0n(O 0n—l(0l- 


(Kh) n 


n\ 


(c) Show that the sum in part (b) converges as n oo and, hence, the sum in part (a) 
also converges as n oo. Conclude therefore that the sequence {0 n (O} converges since 
it is the sequence of partial sums of a convergent infinite series. 


20 The German mathematician Rudolf Lipschitz (1832-1903), professor at the University of Bonn for many 
years, worked in several areas of mathematics. The inequality (i) can replace the hypothesis that df/dy is 
continuous in Theorem 2.8.1; this results in a slightly stronger theorem. 
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19. In this problem we deal with the question of uniqueness of the solution of the integral 
equation (3) 

0(0 = f /[s, 0(0] ds. 

Jo 

(a) Suppose that 0 and 0 are two solutions of Eq. (3). Show that, for t > 0, 

0(0 - 0(0 = f if [s,<K 01 -f[s, iKs)]}ds. 

Jo 

(b) Show that 

10(0 - 0(01 < [ I/[^,0(O1 -f[S, 0(011^. 

Jo 

(c) Use the result of Problem 15 to show that 

10(0-0(01 <W 10(0-0(01 

Jo 

where 7£ is an upper bound for \df/dy\ in D. This is the same as Eq. (30), and the rest of 
the proof may be constructed as indicated in the text. 


2.9 First Order Difference Equations 


Although a continuous model leading to a differential equation is reasonable and 
attractive for many problems, there are some cases in which a discrete model may 
be more natural. For instance, the continuous model of compound interest used in 
Section 2.3 is only an approximation to the actual discrete process. Similarly, some¬ 
times population growth may be described more accurately by a discrete than by 
a continuous model. This is true, for example, of species whose generations do not 
overlap and that propagate at regular intervals, such as at particular times of the cal¬ 
endar year. Then the population y n+ \ of the species in the year n + 1 is some function 
of n and the population y n in the preceding year; that is, 

y n +i =f(n,y„), n = 0,1,2,.... (1) 

Equation (1) is called a first order difference equation. It is first order because the 
value of y n+ \ depends on the value of y n but not on earlier values y n -i,y n - 2 , and so 
forth. As for differential equations, the difference equation (1) is linear if / is a linear 
function of y n \ otherwise, it is nonlinear. A solution of the difference equation (1) is 
a sequence of numbers yo,yi,y 2 , • • • that satisfy the equation for each n. In addition 
to the difference equation itself, there may also be an initial condition 


yo = a (2) 

that prescribes the value of the first term of the solution sequence. 

We now assume temporarily that the function / in Eq. (1) depends only on y n , but 
not on n. In this case 


y n +1 =f(y n ). 


n — 0,1,2,.... 


(3) 





2.9 First Order Difference Equations 


123 


If yo is given, then successive terms of the solution can be found from Eq. (3). Thus 

yi =f(yo). 


and 

y2 =f(yi) = flf Cvo)] • 

The quantity f[f(yo)] is called the second iterate of the difference equation and is 
sometimes denoted by f 2 (yo). Similarly, the third iterate y 3 is given by 

B =f(yi) =f{f[f(yo)]} = / 3 (yo), 
and so on. In general, the nth iterate y n is 

y n =f(y n - 1) —f n (yo)- 

This procedure is referred to as iterating the difference equation. It is often of pri¬ 
mary interest to determine the behavior of y n as n -> oc. In particular, does y n 
approach a limit, and if so, what is it? 

Solutions for which y n has the same value for all n are called equilibrium solutions. 
They are frequently of special importance, just as in the study of differential equations. 
If equilibrium solutions exist, you can find them by setting y n+ \ equal to y n in Eq. (3) 
and solving the resulting equation 


for y n . 


y n = f(y n ) 


(4) 


Linear Equations. Suppose that the population of a certain species in a given region in 
year n + 1, denoted by y n+ i, is a positive multiple p n of the population y n in year n\ 
that is, 

yn +1 = Pnyn-f M = 0, 1,2, ... . (5) 

Note that the reproduction rate p n may differ from year to year. The difference 
equation (5) is linear and can easily be solved by iteration. We obtain 

yi = poyo, 

y2 = Piyi = PiPoyo , 


and, in general, 

y n = Pn- 1 • • • Poyo, n = 1,2,.... (6) 

Thus, if the initial population yo is given, then the population of each succeeding 
generation is determined by Eq. (6). Although for a population problem p n is intrin¬ 
sically positive, the solution (6) is also valid if p n is negative for some or all values of 
n. Note, however, that if p n is zero for some n , then y n+ 1 and all succeeding values of 
y are zero; in other words, the species has become extinct. 

If the reproduction rate p n has the same value p for each n , then the difference 
equation (5) becomes 

y n + 1 = py n (7) 


and its solution is 


y n = p y o. 


( 8 ) 
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Equation (7) also has an equilibrium solution, namely, y n = 0 for all n , corresponding 
to the initial value yo = 0. The limiting behavior of y n is easy to determine from 
Eq. (8). In fact, 

o, if IpI < l; 


lim y n = y 0 , 

n^oo 

does not exist, 


if p = l; 
otherwise. 


(9) 


In other words, the equilibrium solution y n = 0 is asymptotically stable for |p| < 1 
and unstable for |p| > 1. 

Now we will modify the population model represented by Eq. (5) to include the 
effect of immigration or emigration. If b n is the net increase in population in year 
n due to immigration, then the population in year n +1 is the sum of the part of 
the population resulting from natural reproduction and the part due to immigration. 
Thus 

y n +\= py n + b n , n = 0,1,2,..., (10) 


where we are now assuming that the reproduction rate p is constant. We can solve 
Eq. (10) by iteration in the same manner as before. We have 


y i = pyo + b 0 , 

y 2 = pipyo + bo) + bi= p 2 yo + pbo + b u 
B = p(p 2 yo + pbo + hi) + b 2 = p 3 yo + p 2 b 0 + pb\ + b 2 , 


and so forth. In general, we obtain 

n— 1 

yn — P n yo + p n 1 bo + • • • + pb n -2 + b n -1 = p n yo + p n 1 (11) 

7=0 

Note that the first term on the right side of Eq. (11) represents the descendants of 
the original population, while the other terms represent the population in year n 
resulting from immigration in all preceding years. 

In the special case where b n — b ^ 0 for all n , the difference equation is 

y n +1 = py n + b, (12) 

and from Eq. (11) its solution is 

yn = p n yo + (l + p + p 2 + • • • + p n l )b. (13) 


If p / 1, we can write this solution in the more compact form 

y n = p n yo + \ — —b, (14) 

i - p 

where again the two terms on the right side are the effects of the original population 
and of immigration, respectively. Rewriting Eq. (14) as 


y n = p n 



b \ b 
1 - p) + 1 - p 


(15) 


makes the long-time behavior of y n more evident. It follows from Eq. (15) that 
y n -> b/( 1 — p) if |p| < 1. If |p| > 1 or if p = —1 then y n has no limit unless 
y 0 = b/(l — p). The quantity b/(l — p), for p / 1, is an equilibrium solution of 
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EXAMPLE 

1 


Eq. (12), as can readily be seen directly from that equation. Of course, Eq. (14) 
is not valid for p = 1. To deal with that case, we must return to Eq. (13) and let p = 1 
there. It follows that 

y n = yo + nb , (16) 

so in this case y n becomes unbounded as n oo. 

The same model also provides a framework for solving many problems of a finan¬ 
cial character. For such problems, y n is the account balance in the nth time period, 
p n = 1 + r n , where r n is the interest rate for that period, and b n is the amount 
deposited or withdrawn. The following example is typical. 


A recent college graduate takes out a $10,000 loan to purchase a car. If the interest rate is 
12%, what monthly payment is required to pay off the loan in 4 years? 

The relevant difference equation is Eq. (12), where y n is the loan balance outstanding in the 
nth month, p = 1 + r, where r is the interest rate per month and b is the effect of the monthly 
payment. Note that p = 1.01, corresponding to a monthly interest rate of 1%. Since payments 
reduce the loan balance, b must be negative; the actual payment is \b\. 

The solution of the difference equation (12) with this value for p and the initial condition 
y 0 = 10,000 is given by Eq. (15); that is, 

y n = (1.01)" (10,000 + 100ft) - 100ft. (17) 


The value of ft needed to pay off the loan in 4 years is found by setting y 48 = 0 and solving 
for ft. This gives 


ft = 


-100 


(1.01) 48 
( 1 . 01) 48 - 1 


-263.34. 


(18) 


The total amount paid on the loan is 48 times |ft|, or $12,640.32. Of this amount, $10,000 is 
repayment of the principal and the remaining $2640.32 is interest. 


Nonlinear Equations. Nonlinear difference equations are much more complicated and 
have much more varied solutions than linear equations. We will restrict our attention 
to a single equation, the logistic difference equation 

y n +1 = py-n (l - y), (19) 

which is analogous to the logistic differential equation 


dy 

dt 



( 20 ) 


that was discussed in Section 2.5. Note that if the derivative dy/dt in Eq. (20) is 
replaced by the difference (y n +i —y n )/K then Eq. (20) reduces to Eq. (19) with 
p = 1 + hr and k = (1 + hr)K/hr. To simplify Eq. (19) a little more, we can scale the 
variable y n by introducing the new variable u n = y n /k. Then Eq. (19) becomes 

Un+ 1 = pUrSX - U n ), (21) 


where p is a positive parameter. 
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We begin our investigation of Eq. (21) by seeking the equilibrium, or constant, solu¬ 
tions. These can be found by setting u n+ \ equal to u n in Eq. (21), which corresponds 
to setting dy/dt equal to zero in Eq. (20). The resulting equation is 

U n = pU n - pU 2 n , (22) 

so it follows that the equilibrium solutions of Eq. (21) are 

u n = 0, u n = -—- . (23) 

P 

The next question is whether the equilibrium solutions are asymptotically stable or 
unstable. That is, for an initial condition near one of the equilibrium solutions, does 
the resulting solution sequence approach or depart from the equilibrium solution? 
One way to examine this question is by approximating Eq. (21) by a linear equation 
in the neighborhood of an equilibrium solution. For example, near the equilibrium 
solution u n = 0, the quantity u 2 n is small compared to u n itself, so we assume that we 
can neglect the quadratic term in Eq. (21) in comparison with the linear terms. This 
leaves us with the linear difference equation 

Un+l = PUn, (24) 


which is presumably a good approximation to Eq. (21) for u n sufficiently near zero. 
However, Eq. (24) is the same as Eq. (7), and we have already concluded, in Eq. (9), 
that u n -> 0 as n -> oo if and only if |p| < 1, or (since p must be positive) for 
0 < p < 1. Thus the equilibrium solutions = 0 is asymptotically stable for the linear 
approximation (24) for this set of p values, so we conclude that it is also asymptoti¬ 
cally stable for the full nonlinear equation (21). This conclusion is correct, although 
our argument is not complete. What is lacking is a theorem stating that the solutions 
of the nonlinear equation (21) resemble those of the linear equation (24) near the 
equilibrium solution u n = 0. We will not take time to discuss this issue here; the same 
question is treated for differential equations in Section 9.3. 

Now consider the other equilibrium solution u n = (p — l)/p. To study solutions in 
the neighborhood of this point, we write 


_ P ~ 1 | 
u n — + v n , 

P 


(25) 


where we assume that v n is small. By substituting from Eq. (25) in Eq. (21) and 
simplifying the resulting equation, we eventually obtain 

v n +1 = (2 - p)v n - pv 2 n . (26) 

Since v n is small, we again neglect the quadratic term in comparison with the linear 
terms and thereby obtain the linear equation 


v n+ i = (2- p)v n . (27) 

Referring to Eq. (9) once more, we find that v n -> 0 as n -> oo for |2 — p\ < 1, or in 
other words for 1 < p < 3. Therefore, we conclude that for this range of values of p, 
the equilibrium solution u n = (p — l)/p is asymptotically stable. 

Figure 2.9.1 contains the graphs of solutions of Eq. (21) for p = 0.8, p = 1.5, 
and p = 2.8, respectively. Observe that the solution converges to zero for p = 0.8 
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and to the nonzero equilibrium solution for p = 1.5 and p = 2.8. The convergence is 
monotone for p = 0.8 and p = 1.5 and is oscillatory for p = 2.8. The graphs shown 
are for particular initial conditions, but the graphs for other initial conditions are 
similar. 



U n 

0.8 

0.6 

0.4 

0.2 




^ = M = °-6429 






2 4 6 

(c) 

FIGURE 2.9.1 Solutions of u n+ 1 = pu n ( 1 — u n )\ ( a ) p = 0.8; ( b ) p = 1.5; (c) p = 2.8. 


8 n 


Another way of displaying the solution of a difference equation is shown in 
Figure 2.9.2. In each part of this figure, the graphs of the parabola y = px( 1 — x) 
and of the straight line y = x are shown. The equilibrium solutions correspond to 
the points of intersection of these two curves. The piecewise linear graph consist¬ 
ing of successive vertical and horizontal line segments, sometimes called a stairstep 
diagram, represents the solution sequence. The sequence starts at the point uo on 
the x-axis. The vertical line segment drawn upward to the parabola at uo corresponds 
to the calculation of puo(l — uq) = u\. This value is then transferred from the y-axis to 
the %-axis; this step is represented by the horizontal line segment from the parabola 
to the line y = x. Then the process is repeated over and over again. Clearly, the 
sequence converges to the origin in Figure 2.9.2 a and to the nonzero equilibrium 
solution in the other two cases. 

To summarize our results so far: the difference equation (21) has two equilib¬ 
rium solutions, u n = 0 and u n = (p — 1 )/p; the former is asymptotically stable for 
0 < p < 1, and the latter is asymptotically stable for 1 < p < 3. When p = 1, the two 
equilibrium solutions coincide at u = 0; this solution can be shown to be asymptoti¬ 
cally stable. In Figure 2.9.3 the parameter p is plotted on the horizontal axis and u on 
the vertical axis. The equilibrium solutions u = 0 and u = (p — l)/p are shown. The 
intervals in which each one is asymptotically stable are indicated by the solid portions 
of the curves. There is an exchange of stability from one equilibrium solution to the 
other at p = 1. 

For p > 3, neither of the equilibrium solutions is stable, and the solutions of 
Eq. (21) exhibit increasing complexity as p increases. For p somewhat greater than 3, 
the sequence u n rapidly approaches a steady oscillation of period 2; that is, u n oscil¬ 
lates back and forth between two distinct values. For p = 3.2, a solution is shown in 
Figure 2.9.4. For n greater than about 20, the solution alternates between the values 
0.5130 and 0.7995. The graph is drawn for the particular initial condition uq = 0.3, 
but it is similar for all other initial values between 0 and 1. Figure 2.9Ab also shows 
the same steady oscillation as a rectangular path that is traversed repeatedly in the 
clockwise direction. 
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FIGURE 2.9.2 Iterates of u n+ 1 = pu n (l — u n )\ (a) p = 0.8; ( b ) p = 1.5; (c) p — 2.8. 



FIGURE 2.9.3 Exchange of stability for u n+ i = pu n ( 1 — u n ). 
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FIGURE 2.9.4 A solution of u n+1 = pu n ( 1 - u n ) for 
p = 3.2; period 2. (a) u n versus n; ( b ) a two-cycle. 


At about p = 3.449, each state in the oscillation of period 2 separates into two 
distinct states, and the solution becomes periodic with period 4; see Figure 2.9.5, which 
shows a solution of period 4 for p = 3.5. As p increases further, periodic solutions 
of period 8,16,... appear. The appearance of a new solution at a certain parameter 
value is called a bifurcation. 

The p-values at which the successive period doublings occur approach a limit that 
is approximately 3.57. For p > 3.57, the solutions possess some regularity but no 
discernible detailed pattern for most values of p. For example, a solution for p = 3.65 
is shown in Figure 2.9.6. It oscillates between approximately 0.3 and 0.9, but its fine 
structure is unpredictable. The term chaotic is used to describe this situation. One of 
the features of chaotic solutions is extreme sensitivity to the initial conditions. This 
is illustrated in Figure 2.9.7, where two solutions of Eq. (21) for p = 3.65 are shown. 
One solution is the same as that in Figure 2.9.6 and has the initial value uq = 0.3, while 
the other solution has the initial value uo = 0.305. For about 15 iterations the two 
solutions remain close and are hard to distinguish from each other in the figure. After 
that, although they continue to wander about in approximately the same set of values, 
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(a) 



FIGURE 2.9.5 A solution of u n+ 1 = pu n ( 1 - u n ) for p = 3.5; 
period 4. (a) u n versus n\ ( b ) a four-cycle. 



FIGURE 2.9.6 A solution of u n+ 1 = pw n (l — u n ) for p = 3.65; a chaotic solution. 
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FIGURE 2.9.7 Two solutions of u n +\ = pu n (l — u n ) for p = 3.65; u 0 = 0.3 and u 0 = 0.305. 

their graphs are quite dissimilar. It would certainly not be possible to use one of these 
solutions to estimate the value of the other for values of n larger than about 15. 

It is only comparatively recently that chaotic solutions of difference and differential 
equations have become widely known. Equation (20) was one of the first instances of 
mathematical chaos to be found and studied in detail, by Robert May 21 in 1974. On 
the basis of his analysis of this equation as a model of the population of certain insect 
species, May suggested that if the growth rate p is too large, then it will be impossible 
to make effective long-range predictions about these insect populations. The occur¬ 
rence of chaotic solutions in seemingly simple problems has stimulated an enormous 
amount of research, but many questions remain unanswered. It is increasingly clear, 
however, that chaotic solutions are much more common than was suspected at first 
and that they may be a part of the investigation of a wide range of phenomena. 


PROBLEMS 


In each of Problems 1 through 6, solve the given difference equation in terms of the initial 
value yo. Describe the behavior of the solution as n oo. 


1. y n+ 1 = —0.9 y n 


n + 1 

Z ^ = n~+2^ n 


3. y n +i 


n -T 3 
n + 1 


yn 


4. y„ +1 - (-1 r +1 y n 


5. y„+i = 0.5 y n + 6 


6- y n + 1 = -0.5^„ + 6 


21 Robert M. May (1938-) was born in Sydney, Australia, and received his education at the University of 
Sydney with a doctorate in theoretical physics in 1959. His interests soon turned to population dynamics 
and theoretical ecology; the work cited in the text is described in two papers listed in the References at 
the end of this chapter. He has held professorships at Sydney, at Princeton, at Imperial College (London), 
and (since 1988) at Oxford. 
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7. Find the effective annual yield of a bank account that pays interest at a rate of 7%, 
compounded daily; that is, divide the difference between the final and initial balances by 
the initial balance. 

8. An investor deposits $1000 in an account paying interest at a rate of 8%, compounded 
monthly, and also makes additional deposits of $25 per month. Find the balance in the 
account after 3 years. 

9. A certain college graduate borrows $8000 to buy a car. The lender charges interest at an 
annual rate of 10%. What monthly payment rate is required to pay off the loan in 3 years? 
Compare your result with that of Problem 9 in Section 2.3. 

10. A homebuyer wishes to take out a mortgage of $100,000 for a 30-year period. What monthly 
payment is required if the interest rate is (a) 9%, (b) 10%, (c) 12%? 

11. A homebuyer takes out a mortgage of $100,000 with an interest rate of 9%. What monthly 
payment is required to pay off the loan in 30 years? In 20 years? What is the total amount 
paid during the term of the loan in each of these cases? 

12. If the interest rate on a 20-year mortgage is fixed at 10% and if a monthly payment of 
$1000 is the maximum that the buyer can afford, what is the maximum mortgage loan that 
can be made under these conditions? 

13. A homebuyer wishes to finance the purchase with a $95,000 mortgage with a 20-year term. 
What is the maximum interest rate the buyer can afford if the monthly payment is not to 
exceed $900? 

The Logistic Difference Equation. Problems 14 through 19 deal with the difference equation 
(21), u n+ 1 = pu n ( 1 - u„). 

14. Carry out the details in the linear stability analysis of the equilibrium solution 
u n = (p — 1 )/p. That is, derive the difference equation (26) in the text for the pertur¬ 
bation v n . 

15. (a) For p = 3.2, plot or calculate the solution of the logistic equation (21) for several 
initial conditions, say, u 0 = 0.2, 0.4, 0.6, and 0.8. Observe that in each case the solution 
approaches a steady oscillation between the same two values. This illustrates that the 
long-term behavior of the solution is independent of the initial conditions. 

(b) Make similar calculations and verify that the nature of the solution for large n is 
independent of the initial condition for other values of p, such as 2.6,2.8, and 3.4. 

16. Assume that p > 1 in Eq. (21). 

(a) Draw a qualitatively correct stairstep diagram and thereby show that if uo < 0, then 
u n —► —oo as n —► oo. 

(b) In a similar way, determine what happens as n -> oo if uq > 1. 

17. The solutions of Eq. (21) change from convergent sequences to periodic oscillations of 
period 2 as the parameter p passes through the value 3. To see more clearly how this 
happens, carry out the following calculations. 

(a) Plot or calculate the solution for p = 2.9,2.95, and 2.99, respectively, using an initial 
value uq of your choice in the interval (0,1). In each case estimate how many iterations 
are required for the solution to get “very close” to the limiting value. Use any convenient 
interpretation of what “very close” means in the preceding sentence. 

(b) Plot or calculate the solution for p = 3.01,3.05, and 3.1, respectively, using the same 
initial condition as in part (a). In each case estimate how many iterations are needed to 
reach a steady-state oscillation. Also find or estimate the two values in the steady-state 
oscillation. 
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^2/ 18. By calculating or plotting the solution of Eq. (21) for different values of p, estimate the 
value of p at which the solution changes from an oscillation of period 2 to one of period 
4. In the same way, estimate the value of p at which the solution changes from period 4 to 
period 8. 

ffl, 19. Let pk be the value of p at which the solution of Eq. (21) changes from period 2 k ~ x to 
period 2 k . Thus, as noted in the text, pi = 3,p 2 = 3.449, and p 3 = 3.544. 

(a) Using these values of pup 2 , and p 3 , or those you found in Problem 18, calculate 
(p2 - Pl)/(p3 - Pi)- 

(b) Let<5 n = (p n — p n _i)/(p n+ i — p n ) . It can be shown that 8 n approaches a limit <5 as n -> oo, 
where 8 = 4.6692 is known as the Feigenbaum 22 number. Determine the percentage 
difference between the limiting value 8 and 8 2 , as calculated in part (a). 

(c) Assume that 8 3 = 8 and use this relation to estimate p 4 , the value of p at which solutions 
of period 16 appear. 

(d) By plotting or calculating solutions near the value of p 4 found in part (c), try to detect 
the appearance of a period 16 solution. 

(e) Observe that 


Pn — Pi + (p2 ~ Pi) + ( P3 ~ P2) + • • • + (Pn ~ Pn-l)■ 

Assuming that (p 4 — p 3 ) = (p 3 — p 2 )8 ~\ (p$ — p 4 ) = {p 3 — p 2 )8 ~ 2 , and so forth, express p n 
as a geometric sum. Then find the limit of p n as n -> oo. This is an estimate of the value of 
p at which the onset of chaos occurs in the solution of the logistic equation (21). 


PROBLEMS 


Miscellaneous Problems. One of the difficulties in solving first order equations is that there 
are several methods of solution, each of which can be used on a certain type of equation. It 
may take some time to become proficient in matching solution methods with equations. The 
first 32 of the following problems are presented to give you some practice in identifying the 
method or methods applicable to a given equation. The remaining problems involve certain 
types of equations that can be solved by specialized methods. 

In each of Problems 1 through 32, solve the given differential equation. If an initial condition 
is given, also find the solution that satisfies it. 


dy x 3 — 2y 
dx x 





2x + y 
3 + 3y 2 — x 9 

2xy + y 2 + 1 
x 2 + 2xy 

4x 3 + 1 
y(2 + 3y) 


y(0) = 0 


2 dy 1 + cos x 

dx 2 — siny 

dy 

4. — = 3 — 6x + y — 2 xy 
dx 


dy 

x— +xy = l-y, 
dx 

II 

o 

dy „ sinx 

X Tx +2> =— ■ 

y(2) = l 


22 This result for the logistic difference equation was discovered in August 1975 by Mitchell Feigenbaum 
(1944-), while he was working at the Los Alamos National Laboratory. Within a few weeks he had estab¬ 
lished that the same limiting value also appears in a large class of period-doubling difference equations. 
Feigenbaum, who has a doctorate in physics from M.I.T., is now at Rockefeller University. 
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9. 

11 . 

13. 

15. 

17. 

19. 

21 . 

23. 

25. 

26. 

28. 

30. 

32. 

33. 


dy 2 xy + 1 

dx x 2 + 2y 


dy 


(x 2 +y) + (x + ^)-f =0 
dx 

^ = 1 + 2x + y 2 + 2xy 2 
dx 

(e x + 1) ^ = y - ye* 
dx 

dx 

dy 3x 2 - 2y — y 3 
dx 2x + 3xy 2 

rfy 2y 2 + 6xy — 4 

dx 3x 2 + 4xy + 3y 2 

+ (* + l)y = ^ 

dt 


10. (x 2 y + xy-y) + (x 2 y - 2x 2 ) -^ = 0 

dx 

.. dy 1 

12 - ^ + 3 , -rr^ 

dy 

14. (x + y) + (x + 2y) — = 0, y(2) = 3 

. _ dy e~ x cos y — e 2y cos x 
16. — = 


dx —e~ x sin y + 2e 2 y sin x 


18. ^ + 2y = e~ xl ~ 2x , 
dx 


y(0) = 3 


20. y' = e x+ y 

^ dy x 2 - 1 

22 . — = -, 

dx y 2 +1 


y (—i) - i 


9 dy 

24. 2siny sinxcosx + cosy sinx— = 0 

dx 


( 2 ~~ y W * -^^ =0 

\y x 2 +y 2 J^\x 2 +y 2 y 2 ) dx 


y x 2 +y 2 
xy' = y + xe y/x 


dy 

(2 y + 3x) = x —— 
dx 


^ dy 
27. -f- = 


.2, d y 


(3y z + 2 xy) - (2xy + x 2 ) -f- = 0 
dx 

xy' + y — y 2 e 2x = 0, y(l) = 2 

Riccati Equations. The equation 

dy 


dx x 2 y + y 3 

29 dy_ = x + y 

dx x — y 

3i (fy _ 

dx 2x 3 + 3xy ’ 


Hint: Let u = x 2 


y(i) = -2 


dt 


= qi(t) + q 2 (t)y + q 3 (t)y z 


is known as a Riccati 23 equation. Suppose that some particular solution yi of this equation 
is known. A more general solution containing one arbitrary constant can be obtained 
through the substitution 

y = 3'i(0 + — f it. 

v(t) 

Show that v(t) satisfies the first order linear equation 

dv 

+ 2q 3 y t )v - q 3 . 

Note that v(t) will contain a single arbitrary constant. 


23 Riccati equations are named for Jacopo Francesco Riccati (1676-1754), a Venetian nobleman, who 
declined university appointments in Italy, Austria, and Russia to pursue his mathematical studies privately 
at home. Riccati studied these equations extensively; however, it was Euler (in 1760) who discovered the 
result stated in this problem. 
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34. Using the method of Problem 33 and the given particular solution, solve each of the 
following Riccati equations: 



35. The propagation of a single action in a large population (for example, drivers turning on 
headlights at sunset) often depends partly on external circumstances (gathering darkness) 
and partly on a tendency to imitate others who have already performed the action in 
question. In this case the proportion y(t) of people who have performed the action can be 
described 24 by the equation 


dy/dt = (1 - y)[x(t) + by], 


where x(t) measures the external stimulus and b is the imitation coefficient. 

(a) Observe that Eq. (i) is a Riccati equation and that y\(t) = 1 is one solution. Use the 
transformation suggested in Problem 33, and find the linear equation satisfied by v(t). 

(b) Find v(t) in the case that x(t) = at, where a is a constant. Leave your answer in the 
form of an integral. 

Some Special Second Order Equations. Second order equations involve the second deriva¬ 
tive of the unknown function and have the general form y" — f(t, y ,/). Usually such equations 
cannot be solved by methods designed for first order equations. However, there are two types 
of second order equations that can be transformed into first order equations by a suitable 
change of variable. The resulting equation can sometimes be solved by the methods presented 
in this chapter. Problems 36 through 51 deal with these types of equations. 

Equations with the Dependent Variable Missing. For a second order differential equation 
of the form y" — f(t,y'), the substitution v = /, v' = y" leads to a first order equation of the 
form v' = fit, v). If this equation can be solved for v, then y can be obtained by integrating 
dy/dt = v. Note that one arbitrary constant is obtained in solving the first order equation for 
v, and a second is introduced in the integration for y. In each of Problems 36 through 41, use 
this substitution to solve the given equation. 


36. t 2 y" + 2ty' - 1 = 0, t> 0 
38. y" + t(y') 2 = 0 
40. y" + y' = e~ l 


37. ty"+y' = l, t> 0 
39. 2 t 2 y" + (yO 3 = 2 ty', t > 0 

41. t 2 y" = iy') 2 , t > 0 


Equations with the Independent Variable Missing. Consider second order differential equa¬ 
tions of the form y" = f(y,y in which the independent variable t does not appear explicitly. 
If we let v = y', then we obtain dv/dt = f(y, v). Since the right side of this equation depends on 
y and v, rather than on t and v, this equation contains too many variables. However, if we think 
of y as the independent variable, then by the chain rule, dv/dt = (dv/dy) (dy/dt) = v(dv/dy). 
Hence the original differential equation can be written as v(dv/dy) =f(y,v). Provided that 
this first order equation can be solved, we obtain v as a function of y. A relation between y 
and t results from solving dy/dt = v(y), which is a separable equation. Again, there are two 


24 See Anatol Rapoport, “Contribution to the Mathematical Theory of Mass Behavior: I. The Propagation 
of Single Acts,” Bulletin of Mathematical Biophysics 14 (1952), pp. 159-169, and John Z. Hearon, “Note 
on the Theory of Mass Behavior,” Bulletin of Mathematical Biophysics 17 (1955), pp. 7-13. 
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CHAPTER 


Second Order Linear 
Equations 


3 


Linear equations of second order are of crucial importance in the study of differential 
equations for two main reasons. The first is that linear equations have a rich theo¬ 
retical structure that underlies a number of systematic methods of solution. Further, 
a substantial portion of this structure and of these methods is understandable at a 
fairly elementary mathematical level. In order to present the key ideas in the sim¬ 
plest possible context, we describe them in this chapter for second order equations. 
Another reason to study second order linear equations is that they are vital to any 
serious investigation of the classical areas of mathematical physics. One cannot go 
very far in the development of fluid mechanics, heat conduction, wave motion, or 
electromagnetic phenomena without finding it necessary to solve second order lin¬ 
ear differential equations. As an example, we discuss the oscillations of some basic 
mechanical and electrical systems at the end of the chapter. 


3.1 Homogeneous Equations with Constant Coefficients 


A second order ordinary differential equation has the form 



a) 


where / is some given function. Usually, we will denote the independent variable 
by t since time is often the independent variable in physical problems, but some¬ 
times we will use x instead. We will use y, or occasionally some other letter, to 
designate the dependent variable. Equation (1) is said to be linear if the function/ 
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has the form 

f (t,y, = gO)~pO - q(t)y, (2) 

that is, if / is linear in y and dy/dt. In Eq. (2) g,p , and q are specified functions of 
the independent variable t but do not depend on y. In this case we usually rewrite 
Eq. (1) as 

y" + pO)y' + q(t)y = git), (3) 


where the primes denote differentiation with respect to t. Instead of Eq. (3), we often 
see the equation 

PU)y" + Q(t)y' + R(t)y = G(t). (4) 


Of course, if P(t) / 0, we can divide Eq. (4) by P(t) and thereby obtain Eq. (3) with 


Pit) = 


6(0 

Pity 


Pit) 

qU} = WY 


git) = 


Git) 

Pit) ‘ 


( 5 ) 


In discussing Eq. (3) and in trying to solve it, we will restrict ourselves to intervals in 
which p, q, and g are continuous functions. 1 

If Eq. (1) is not of the form (3) or (4), then it is called nonlinear. Analytical investi¬ 
gations of nonlinear equations are relatively difficult, so we will have little to say about 
them in this book. Numerical or geometical approaches are often more appropriate, 
and these are discussed in Chapters 8 and 9. 

An initial value problem consists of a differential equation such as Eq. (1), (3), or 
(4) together with a pair of initial conditions 


yito) = yo, /Ob) = y' 0 . 


( 6 ) 


where yo and y' 0 are given numbers prescribing values for y and y' at the initial 
point to- Observe that the initial conditions for a second order equation identify not 
only a particular point (to,yo) through which the graph of the solution must pass, 
but also the slope y f 0 of the graph at that point. It is reasonable to expect that two 
initial conditions are needed for a second order equation because, roughly speaking, 
two integrations are required to find a solution and each integration introduces an 
arbitrary constant. Presumably, two initial conditions will suffice to determine values 
for these two constants. 

A second order linear equation is said to be homogeneous if the term g(t) in 
Eq. (3), or the term G(t) in Eq. (4), is zero for all t. Otherwise, the equation is 
called nonhomogeneous. As a result, the term g(t), or G(t), is sometimes called the 
nonhomogeneous term. We begin our discussion with homogeneous equations, which 
we will write in the form 


P(t)y" + Q(t)y' + R(t)y = 0. (7) 

Later, in Sections 3.5 and 3.6, we will show that once the homogeneous equation 
has been solved, it is always possible to solve the corresponding nonhomogeneous 


lr There is a corresponding treatment of higher order linear equations in Chapter 4. If you wish, you may 
read the appropriate parts of Chapter 4 in parallel with Chapter 3. 
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equation (4), or at least to express the solution in terms of an integral. Thus the 
problem of solving the homogeneous equation is the more fundamental one. 

In this chapter we will concentrate our attention on equations in which the 
functions P, Q , and R are constants. In this case, Eq. (7) becomes 

ay" + by' + cy = 0, (8) 

where a , b , and c are given constants. It turns out that Eq. (8) can always be solved 
easily in terms of the elementary functions of calculus. On the other hand, it is usu¬ 
ally much more difficult to solve Eq. (7) if the coefficients are not constants, and 
a treatment of that case is deferred until Chapter 5. Before taking up Eq. (8), let 
us first gain some experience by looking at a simple example that in many ways is 
typical. 


Solve the equation 

EXAMPLE y"-y = o, (9) 

and also find the solution that satisfies the initial conditions 

y(0) = 2, /(0) = -1. (10) 

Observe that Eq. (9) is just Eq. (8) with a = 1, b = 0, and c = —1. In words, Eq. (9) says that 
we seek a function with the property that the second derivative of the function is the same as the 
function itself. Do any of the functions that you studied in calculus have this property? A little 
thought will probably produce at least one such function, namely, yi(t) = e f , the exponential 
function. A little more thought may also produce a second function, y 2 (t) = e~ f . Some further 
experimentation reveals that constant multiples of these two solutions are also solutions. For 
example, the functions 2e l and 5e~ f also satisfy Eq. (9), as you can verify by calculating their 
second derivatives. In the same way, the functions c\y\{t) = cie f and C 2 y 2 (t) = C 2 e~ l satisfy the 
differential equation (9) for all values of the constants c\ and c 2 . 

Next, it is vital to notice that the sum of any two solutions of Eq. (9) is also a solution. 
In particular, since c\yi(t) and C2)>2(0 are solutions of Eq. (9) for any values of c\ and C 2 , so is 
the function 

y = c\y \(0 + c 2 y 2 (t) = cie' + c 2 e~‘. (11) 

Again, this can be verified by calculating the second derivative y" from Eq. (11). We have 
y' = cie f — C 2 e~ f and y" = c\e f + c 2 e -r ; thus y" is the same as y, and Eq. (9) is satisfied. 

Let us summarize what we have done so far in this example. Once we notice that the functions 
yi(t) = e l andy 2 (0 = e~ l are solutions of Eq. (9), it follows that the general linear combination 
(11) of these functions is also a solution. Since the coefficients c\ and c 2 in Eq. (11) are arbitrary, 
this expression represents an infinite family of solutions of the differential equation (9). 

It is now possible to consider how to pick out a particular member of this infinite family of 
solutions that also satisfies a given set of initial conditions (10). In other words, we seek the 
solution that passes through the point (0,2) and at that point has the slope —1. First, we set 
t = 0 and y = 2 in Eq. (11); this gives the equation 

C! + c 2 = 2. (12) 

Next, we differentiate Eq. (11) with the result that 

y' = c\e l — c 2 e _r . 
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Then, setting t = 0 and y' = —1, we obtain 

ci-c 2 = -1. (13) 

By solving Eqs. (12) and (13) simultaneously for c\ and c 2 , we find that 

Cl = §, C 2 = |. (14) 

Finally, inserting these values in Eq. (11), we obtain 


y =\e* + \e \ 


(15) 


the solution of the initial value problem consisting of the differential equation (9) and the 
initial conditions (10). 


What conclusions can we draw from the preceding example that will help us to 
deal with the more general equation (8), 

ay" + by' + cy = 0, 

whose coefficients a , b , and c are arbitrary (real) constants? In the first place, in the 
example the solutions were exponential functions. Further, once we had identified 
two solutions, we were able to use a linear combination of them to satisfy the given 
initial conditions as well as the differential equation itself. 

It turns out that by exploiting these two ideas, we can solve Eq. (8) for any values 
of its coefficients and also satisfy any given set of initial conditions for y and y'. 
We start by seeking exponential solutions of the form y = e rt , where r is a parameter 
to be determined. Then it follows that y' = re n and y" = r 2 e n . By substituting these 
expressions for y, /, and y" in Eq. (8), we obtain 

(i ar 2 + br + c)e rt = 0, 


or, since e rt ^ 0, 

ar 2 + br + c = 0. (16) 

Equation (16) is called the characteristic equation for the differential equation (8). 
Its significance lies in the fact that if r is a root of the polynomial equation (16), then 
y = e rt is a solution of the differential equation (8). Since Eq. (16) is a quadratic 
equation with real coefficients, it has two roots, which may be real and different, real 
but repeated, or complex conjugates. We consider the first case here and the latter 
two cases in Sections 3.3 and 3.4. 

Assuming that the roots of the characteristic equation (16) are real and different, 
let them be denoted by r\ and r 2 , where r\ ^ r 2 . Then y\(t) = e nt and y 2 (t) = e nt are 
two solutions of Eq. (8). Just as in Example 1, it now follows that 

y = ciyi(t) + c 2 yi(t) = cie nt + c 2 e nt (17) 

is also a solution of Eq. (8). To verify that this is so, we can differentiate the expression 
in Eq. (17); hence 

/ = c\rie rxt + c 2 r 2 e r2t (18) 


and 


y" = c\r\e rit + c 2 r\e rit . 


( 19 ) 
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Substituting these expressions for y, /, and y" in Eq. (8) and rearranging terms, we 
obtain 

ay" + by' + cy = c\{ar\ + br\ + c)e rit + c 2 (ar\ + br 2 + c)e rit . (20) 

The quantities in the two sets of parentheses on the right-hand side of Eq. (20) are 
zero because r\ and r 2 are roots of Eq. (16); therefore,}; as given by Eq. (17) is indeed 
a solution of Eq. (8), as we wished to verify. 

Now suppose that we want to find the particular member of the family of solutions 
(17) that satisfies the initial conditions (6) 


y(to) = yo, y'(t 0 ) = y' 0 . 

By substituting t = to and y = yo in Eq. (17), we obtain 

cie ritQ + c 2 e r2t ° = yo. (21) 

Similarly, setting t = to and y' = y' 0 in Eq. (18) gives 

c 1 r 1 e rit ° + c 2 r 2 e r2t ° = y' 0 . (22) 


On solving Eqs. (21) and (22) simultaneously for c\ and c 2 , we find that 


ci 


y f o-yo r 2 e -nt 0 ^ 

n - r 2 


c 2 = Q. 

n - r 2 


(23) 


Recall that r\ — r 2 ^ 0 so that the expressions in Eq. (23) always make sense. Thus, 
no matter what initial conditions are assigned—that is, regardless of the values of 
to, yo, and }>q in Eqs. (6)—it is always possible to determine c\ and c 2 so that the 
initial conditions are satisfied. Moreover, there is only one possible choice of c\ and 
c 2 for each set of initial conditions. With the values of c\ and c 2 given by Eq. (23), the 
expression (17) is the solution of the initial value problem 


ay" + by' + cy = 0, y(t 0 ) = y 0 , y'(t 0 ) = y' 0 . (24) 

It is possible to show, on the basis of the fundamental theorem cited in the next 
section, that all solutions of Eq. (8) are included in the expression (17), at least for the 
case in which the roots of Eq. (16) are real and different. Therefore, we call Eq. (17) 
the general solution of Eq. (8). The fact that any possible initial conditions can be 
satisfied by the proper choice of the constants in Eq. (17) makes more plausible the 
idea that this expression does include all solutions of Eq. (8). 

Let us now look at some further examples. 


EXAMPLE 

2 


Find the general solution of 

y" + 5/ + 6y = 0. (25) 

We assume that y = e rt , and it then follows that r must be a root of the characteristic equation 
r 2 + 5r + 6 = (r + 2 ){r + 3) = 0. 

Thus the possible values of r are r { = —2 and r 2 = —3; the general solution of Eq. (25) is 

y = cie -2 ' + c 2 e~ 3 ‘. 


( 26 ) 
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EXAMPLE 

3 


Find the solution of the initial value problem 

y" + 5/ + 6y = 0, 0) = 2, /(0) = 3. (27) 

The general solution of the differential equation was found in Example 2 and is given by 
Eq. (26). To satisfy the first initial condition, we set t = 0 and y = 2 in Eq. (26); thus c\ and c 2 
must satisfy 

C\ T c 2 — 2. (28) 

To use the second initial condition, we must first differentiate Eq. (26). This gives 
y' = —2ci^ _2r — 3 c 2 e~ 3t . Then, setting t = 0 and y' = 3, we obtain 

-2d - 3 c 2 = 3. (29) 

By solving Eqs. (28) and (29), we find that c\ = 9 and c 2 = —7. Using these values in the 
expression (26), we obtain the solution 

y = 9e~ 2t - le~ 3t (30) 

of the initial value problem (27). The graph of the solution is shown in Figure 3.1.1. 


y = 9e 2t - le 3t 


0.5 1 1.5 2 t 

FIGURE 3.1.1 Solution of the initial value problem (27): 
y" + 5/ + 6y = 0, y(0) = 2, /(0) = 3. 


EXAMPLE 

4 


Find the solution of the initial value problem 

Ay" - 8/ + 3y = 0, y( 0) = 2, /(()) = \ . (31) 

If y — e rt , then we obtain the characteristic equation 

4r 2 — 8r + 3 = 0 

whose roots are r = 3/2 and r = 1/2. Therefore, the general solution of the differential 
equation is 

_y = Cl e 3 '/ 2 + c 2 e' /2 . (32) 

Applying the initial conditions, we obtain the following two equations for c\ and c 2 : 

ci + c 2 = 2, |d + |c 2 = |. 

The solution of these equations is c\ = — ~, c 2 = |, so the solution of the initial value problem 
(31) is 

y = -±e 3t/2 + y t/2 . (33) 

Figure 3.1.2 shows the graph of the solution. 
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EXAMPLE 

5 



FIGURE 3.1.2 Solution of the initial value problem (31): 
4y" - 8/ + 3y = 0, y(0) = 2, /(0) = 0.5. 


The solution (30) of the initial value problem (27) initially increases (because its initial slope 
is positive) but eventually approaches zero (because both terms involve negative exponential 
functions). Therefore, the solution must have a maximum point, and the graph in Figure 3.1.1 
confirms this. Determine the location of this maximum point. 

The coordinates of the maximum point can be estimated from the graph, but to find 
them more precisely, we seek the point where the solution has a horizontal tangent line. 
By differentiating the solution (30), y = 9e~ 2t — le~ 3t , with respect to t, we obtain 

/ = —lSe~ 2t + 21e~ 3t . (34) 

Setting y equal to zero and multiplying by e 3f ,we find that the critical value t m satisfies e* = 7 /6; 
hence 

t m = In (7/6) = 0.15415. (35) 

The corresponding maximum value y m is given by 

108 

y m = 9e~ 2,m - le~ 3,m = — = 2.20408. (36) 

In this example the initial slope is 3, but the solution of the given differential equation 
behaves in a similar way for any other positive initial slope. In Problem 26 you are asked to 
determine how the coordinates of the maximum point depend on the initial slope. 

Returning to the equation ay" + by' + cy = 0 with arbitrary coefficients, recall 
that when r\ / r 2 , its general solution (17) is the sum of two exponential functions. 
Therefore, the solution has a relatively simple geometrical behavior: as t increases, 
the magnitude of the solution either tends to zero (when both exponents are nega¬ 
tive) or else grows rapidly (when at least one exponent is positive). These two cases 
are illustrated by the solutions of Examples 3 and 4, which are shown in Figures 3.1.1 
and 3.1.2, respectively. There is also a third case that occurs less often: the solution 
approaches a constant when one exponent is zero and the other is negative. 

In Sections 3.3 and 3.4, respectively, we return to the problem of solving the 
equation ay” + by' + cy = 0 when the roots of the characteristic equation either 
are complex conjugates or are real and equal. In the meantime, in Section 3.2, 
we provide a systematic discussion of the mathematical structure of the solutions 
of all second order linear homogeneous equations. 
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PROBLEMS In each of Problems 1 through 8, find the general solution of the given differential equation. 
1. /' + 2/ - 3y = 0 2. /' + 3/ + 2y = 0 

3. 6y" — y' — y = 0 4. 2y" - 3/ + y = 0 

5. /' + 5/ = 0 6. 4/' - 9y = 0 

7. /' - 9/ + 9y = 0 8. y" -2/-2y = 0 


In each of Problems 9 through 16, find the solution of the given initial value problem. Sketch 
the graph of the solution and describe its behavior as t increases. 

9. y" + y - 2y = 0, y(0) = 1, /(0) = 1 

10. /' + 4/ + 3y = 0, y( 0)=2, /(0) = -1 

11. 6/' - 5/ + y = 0, y(0) = 4, /(0) = 0 

12. /' + 3/ = 0, 3'(0) = -2, /(0) = 3 

13. /' + 5/ + 3y = 0, y( 0) = 1, y(0) = 0 

14. 2y" + y - 4y = 0, y(0) = 0, /(0) = 1 

15. /' + 8/ -9y = 0, y( 1) = 1, /(l) = 0 

16. 4y" -y = 0, y(-2) = 1, y(-2) = -1 

17. Find a differential equation whose general solution is y = C\e 2t + c 2 e~ 3t . 

18. Find a differential equation whose general solution is y = c\e~ t/2 + c 2 e~ 2t . 

19. Find the solution of the initial value problem 


y"-y = o, y(0) = f, /(0) = -|. 


Plot the solution for 0 < t < 2 and determine its minimum value. 

20. Find the solution of the initial value problem 

2y" — 3/ + y = 0, y(0) = 2, /(0) = 


Then determine the maximum value of the solution and also find the point where the 
solution is zero. 

21. Solve the initial value problem y" — y' — 2y = 0, _y(0) = a, y (0) = 2. Then find a so that 
the solution approaches zero as t oo. 

22. Solve the initial value problem 4 y" — y = 0, y(0) = 2 , /(0) = ft. Then find /3 so that the 
solution approaches zero as t oo. 

In each of Problems 23 and 24, determine the values of a, if any, for which all solutions tend to 

zero as t oo; also determine the values of a , if any, for which all (nonzero) solutions become 

unbounded as t -> oo. 

23. y" - (2a - 1 )y' + a(a -l)y = 0 

24. y" + (3 - a)y' - 2(a - l)y = 0 

25. Consider the initial value problem 


2/ + 3y-2y = 0, y(0) = 1, /(0) =-0, 


where 0 > 0. 

(a) Solve the initial value problem. 

(b) Plot the solution when 0 = 1. Find the coordinates (to,yo) of the minimum point of 
the solution in this case. 

(c) Find the smallest value of 0 for which the solution has no minimum point. 
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26. Consider the initial value problem (see Example 5) 

/ + 5/ + 6y = 0, y( 0) = 2, /(0) = p, 

where ft > 0. 

(a) Solve the initial value problem. 

(b) Determine the coordinates t m and y m of the maximum point of the solution as func¬ 
tions of p. 

(c) Determine the smallest value of p for which y m > 4. 

(d) Determine the behavior of t m and y m as p -> oo. 

27. Consider the equation ay" + by' + cy = d, where a , b, c, and d are constants. 

(a) Find all equilibrium, or constant, solutions of this differential equation. 

(b) Let y e denote an equilibrium solution, and let Y = y — y e . Thus Y is the deviation of 
a solution y from an equilibrium solution. Find the differential equation satisfied by Y. 

28. Consider the equation ay" + by' + cy = 0, where a, b , and c are constants with a > 0. Find 
conditions on a, b , and c such that the roots of the characteristic equation are: 

(a) real, different, and negative. 

(b) real with opposite signs. 

(c) real, different, and positive. 


3.2 Solutions of Linear Homogeneous Equations; the Wronskian 


In the preceding section we showed how to solve some differential equations of the 
form 

ay" + by' + cy = 0, 

where a , b , and c are constants. Now we build on those results to provide a clearer 
picture of the structure of the solutions of all second order linear homogeneous 
equations. In turn, this understanding will assist us in finding the solutions of other 
problems that we will encounter later. 

To discuss general properties of linear differential equations, it is helpful to intro¬ 
duce a differential operator notation. Let p and q be continuous functions on an 
open interval /—that is, for a < t < p. The cases for a = — oo, or p = oo, or both, 
are included. Then, for any function 0 that is twice differentiable on /, we define the 
differential operator L by the equation 

L[0] = 4>" + p<fi' + q<fi. (1) 

Note that L[0] is a function on I. The value of L[0] at a point t is 

am) = + P m\t) + qmay 

For example, if pit) = t 2 , q(t) = 1 + t, and 0(0 = sin 3 1, then 

L[0](O = (sinSO^ + (sin 30' + (1 + t) sin3£ 

= —9 sin 3 1 + 3 1 2 cos 3t + (1 + t) sin 3 1. 
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The operator L is often written as L = D 2 + pD + q , where D is the derivative 
operator. 

In this section we study the second order linear homogeneous equation 
L[0](t) = 0. Since it is customary to use the symbol y to denote 0(0, we will usually 
write this equation in the form 

L[y]= y" +p(t)y' + q(t)y = 0. (2) 

With Eq. (2) we associate a set of initial conditions 

y(to) = yo, y'(t 0 ) = y' 0 , (3) 

where to is any point in the interval /, and yo and are given real numbers. 
We would like to know whether the initial value problem (2), (3) always has a solu¬ 
tion, and whether it may have more than one solution. We would also like to know 
whether anything can be said about the form and structure of solutions that might 
be helpful in finding solutions of particular problems. Answers to these questions are 
contained in the theorems in this section. 

The fundamental theoretical result for initial value problems for second order 
linear equations is stated in Theorem 3.2.1, which is analogous to Theorem 2.4.1 
for first order linear equations. The result applies equally well to nonhomogeneous 
equations, so the theorem is stated in that form. 


Theorem 3.2.1 (Existence and Uniqueness Theorem) 

Consider the initial value problem 

y" +p(t)y' + q(t)y = g(t), y(t 0 ) = yo, y'(t 0 ) = y' 0 , (4) 

where p, q, and g are continuous on an open interval I that contains the point to . 
Then there is exactly one solution y = 0(0 of this problem, and the solution exists 
throughout the interval 1. 


We emphasize that the theorem says three things: 

1. The initial value problem has a solution; in other words, a solution exists. 

2. The initial value problem has only one solution; that is, the solution is unique. 

3. The solution 0 is defined throughout the interval I where the coefficients are continuous 
and is at least twice differentiable there. 

For some problems some of these assertions are easy to prove. For instance, we 
found in Example 1 of Section 3.1 that the initial value problem 

y" — y = o, y(0) = 2 , /(0) = -i (5) 

has the solution 

y=\e t + (6) 

The fact that we found a solution certainly establishes that a solution exists for this 
initial value problem. Further, the solution (6) is twice differentiable, indeed differen¬ 
tiable any number of times, throughout the interval (—00,00) where the coefficients 
in the differential equation are continuous. On the other hand, it is not obvious, and 
is more difficult to show, that the initial value problem (5) has no solutions other 
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EXAMPLE 

1 


EXAMPLE 

2 


Theorem 3.2.2 


than the one given by Eq. (6). Nevertheless, Theorem 3.2.1 states that this solution 
is indeed the only solution of the initial value problem (5). 

For most problems of the form (4), it is not possible to write down a useful expres¬ 
sion for the solution. This is a major difference between first order and second order 
linear equations. Therefore, all parts of the theorem must be proved by general meth¬ 
ods that do not involve having such an expression. The proof of Theorem 3.2.1 is fairly 
difficult, and we do not discuss it here. 2 We will, however, accept Theorem 3.2.1 as 
true and make use of it whenever necessary. 


Find the longest interval in which the solution of the initial value problem 
(t 2 -3t)y" + ty'-(t + 3)y = 0, y( 1) = 2, /(1) = 1 


is certain to exist. 

If the given differential equation is written in the form of Eq. (4), then p(t) = l/(t — 3), 
q(t) = —(t + 3 )/t(t — 3), and g(t) = 0. The only points of discontinuity of the coefficients are 
t = 0 and t = 3. Therefore, the longest open interval, containing the initial point t = 1, in 
which all the coefficients are continuous is 0 < t < 3. Thus, this is the longest interval in which 
Theorem 3.2.1 guarantees that the solution exists. 


Find the unique solution of the initial value problem 

y” + p(t)y' + q(t)y = o, y(t 0 ) = 0, y'(t 0 ) = 0, 

where p and q are continuous in an open interval I containing to. 

The function y = 4>{t) = 0 for all t in I certainly satisfies the differential equation and ini¬ 
tial conditions. By the uniqueness part of Theorem 3.2.1, it is the only solution of the given 
problem. 


Let us now assume that y\ and y 2 are two solutions of Eq. (2); in other words, 

Uyi] = y'i + py[ + = o, 

and similarly for Then, just as in the examples in Section 3.1, we can generate 
more solutions by forming linear combinations of y\ and y 2 . We state this result as a 
theorem. 


(Principle of Superposition) 

If yi and y 2 are two solutions of the differential equation (2), 

L[y] = y" + p{t)y r + q(t)y = 0, 

then the linear combination c\y\ + C 2 y 2 is also a solution for any values of the 
constants ci and C 2 . 


2 A proof of Theorem 3.2.1 can be found, for example, in Chapter 6, Section 8 of the book by Coddington 
listed in the references at the end of this chapter. 
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A special case of Theorem 3.2.2 occurs if either c\ or is zero. Then we conclude 
that any constant multiple of a solution of Eq. (2) is also a solution. 

To prove Theorem 3.2.2, we need only substitute 

y = Ciyi(t) + c 2 y 2 (t) (7) 

for y in Eq. (2). By calculating the indicated derivatives and rearranging terms, we 
obtain 

L[c\yi + c 2 y 2 ] = [ciyi + c 2 y 2 \' + p[c\yi + c 2 y 2 ]' + q[c\y\ + c 2 y 2 ] 

= ciy'l + c 2 y 2 + cipy[ + c 2 py' 2 + c 1 qy 1 + c 2 qy 2 
= ci \y'[ + py'i + qyi I + c 2 [y 2 + py 2 + qyi \ 

= ciL\yi\ + c 2 L\y 2 \. 

Since L[y\] = 0 and L[y 2 \ = 0, it follows that L[c\y\ + c^y^X = 0 also. Therefore, 
regardless of the values of c\ and C 2 , y as given by Eq. (7) satisfies the differential 
equation (2), and the proof of Theorem 3.2.2 is complete. 

Theorem 3.2.2 states that, beginning with only two solutions of Eq. (2), we can 
construct an infinite family of solutions by means of Eq. (7). The next question is 
whether all solutions of Eq. (2) are included in Eq. (7) or whether there may be 
other solutions of a different form. We begin to address this question by examining 
whether the constants c\ and C 2 in Eq. (7) can be chosen so as to satisfy the initial 
conditions (3). These initial conditions require c\ and C 2 to satisfy the equations 


ciyi(t 0 ) + c 2 y 2 (to) =yo, 
ciy[(to) + c 2 y 2 (t 0 ) = y' 0 . 

The determinant of coefficients of the system (8) is 


( 8 ) 


W = 


yi(to) 

y[(to) 


y2(to) 

y 2 (to) 


= yi(to)y 2 (t 0 ) -y[(t 0 )y 2 (to). 


( 9 ) 


If W / 0, then Eqs. (8) have a unique solution ( 01 , 02 ) regardless of the values of 
Vo and y' () . This solution is given by 


-yo/ifa) + ypJ'i(fo) 
yi(t 0 )y' 2 (t 0 ) - y[(t 0 )y 2 (to) ’ 


yo yi(to) 


yi(to) yo 

y'o y 2 (to) 


y'i(fo) y’ 0 


yiik) 

y2(to) 

C2= ~ 

yi(to) 

y2(to) 

y[(to) 

y' 2 (to) 


y[(to) 

y' 2 (to ) 


_ ypy^itp) - ToT2(fo) 

Cl yi(to)y 2 (to) -y[(to)y 2 (to) ’ 

or, in terms of determinants, 


( 10 ) 


( 11 ) 


With these values for c\ and c 2 , the linear combination y = c\y\(t) + c 2 y 2 (t) satis¬ 
fies the initial conditions (3) as well as the differential equation (2). Note that the 
denominator in the expressions for c\ and C 2 is the nonzero determinant W. 

On the other hand, if W = 0, then the denominators appearing in Eqs. (10) and 
(11) are zero. In this case Eqs. (8) have no solution unless yo and y' 0 have values that 
also make the numerators in Eqs. (10) and (11) equal to zero. Thus, if W = 0, there are 
many initial conditions that cannot be satisfied no matter how c\ and C 2 are chosen. 

















3.2 Solutions of Linear Homogeneous Equations; the Wronskian 


149 


Theorem 3.2.3 


EXAMPLE 

3 


Theorem 3.2.4 


The determinant W is called the Wronskian 3 determinant, or simply the Wronskian, 
of the solutions y\ and y 2 . Sometimes we use the more extended notation W (y 1 , y 2 ) (to) 
to stand for the expression on the right side of Eq. (9), thereby emphasizing that the 
Wronskian depends on the functions y\ and y 2 , and that it is evaluated at the point 
to. The preceding argument establishes the following result. 

Suppose that y\ and y 2 are two solutions of Eq. (2) 

L[y] = y" +p(t)y f + q(t)y = 0, 
and that the initial conditions (3) 

y(to) = yo, Vito) = y' 0 

are assigned. Then it is always possible to choose the constants ci, C 2 so that 

y = c\yi(t) + c 2 y 2 {t) 

satisfies the differential equation (2) and the initial conditions (3) if and only if the 
Wronskian 

W = yiy f 2 - y[y 2 

is not zero at to. 


In Example 2 of Section 3.1 we found that y\(t) = e~ 2t and y 2 (t) = e~ 3t are solutions of the 
differential equation 

y" + 5y f + 6y = 0. 


Find the Wronskian of yi and y 2 . 

The Wronskian of these two functions is 


W = 


e 


- 2 1 


-2e~ 2t 



—e 


- 5 1 


Since W is nonzero for all values of t , the functions yi and y 2 can be used to construct solutions 
of the given differential equation, together with initial conditions prescribed at any value of t. 
One such initial value problem was solved in Example 3 of Section 3.1. 


The next theorem justifies the term “general solution” that we introduced in 
Section 3.1 for the linear combination c\y\ + c 2 y 2 . 


Suppose that y\ and y 2 are two solutions of the differential equation (2), 

L[y] = y" + p(t)y' + q(t)y = 0. 

Then the family of solutions 


y = ciyiit) + c 2 y 2 (0 

with arbitrary coefficients ci and C 2 includes every solution of Eq. (2) if and only if 
there is a point to where the Wronskian of y\ and y 2 is not zero. 


3 Wronskian determinants are named for Josef Maria Hoene-Wronski (1776-1853), who was born in Pol¬ 
and but spent most of his life in France. Wronski was a gifted but troubled man, and his life was marked 
by frequent heated disputes with other individuals and institutions. 
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Let 0 be any solution of Eq. (2). To prove the theorem, we must determine whether 
0 is included in the linear combinations c\y\ + c^y^. That is, we must determine 
whether there are values of the constants c\ and that make the linear combi¬ 
nation the same as 0. Let to be a point where the Wronskian of y\ and y 2 is nonzero. 
Then evaluate 0 and 0' at this point and call these values yo and y' 0 , respectively; thus 

yo = <P(to), y'o = 

Next, consider the initial value problem 

y" +p(t)y' + q(t)y = o, y(t Q ) = y 0 , y'(t 0 ) = y' 0 . (12) 

The function 0 is certainly a solution of this initial value problem. Further, because 
we are assuming that W(yi,y 2 )(to) is nonzero, it is possible (by Theorem 3.2.3) 
to choose c\ and ci such that y — c\y\(t) + C 2 yi{t) is also a solution of the initial 
value problem (12). In fact, the proper values of c\ and are given by Eqs. (10) or 
(11). The uniqueness part of Theorem 3.2.1 guarantees that these two solutions of 
the same initial value problem are actually the same function; thus, for the proper 
choice of c\ and C 2 , 

<P(t ) = c\y\(t) + c 2 yi(t), (13) 

and therefore 0 is included in the family of functions c\y\ + C 2 ^ 2 - Finally, since 0 is an 
arbitrary solution of Eq. (2), it follows that every solution of this equation is included 
in this family. 

Now suppose that there is no point to where the Wronskian is nonzero. Thus 
W(yi,y 2 )(to) = 0 no matter which point to is selected. Then (by Theorem 3.2.3) there 
are values of yo and y f 0 such that the system ( 8 ) has no solution for c\ and C 2 . Select 
a pair of such values and choose the solution 0(t) of Eq. (2) that satisfies the initial 
condition (3). Observe that such a solution is guaranteed to exist by Theorem 3.2.1. 
However, this solution is not included in the family y — c\y\ + C 2 }^ 2 • Thus this linear 
combination does not include all solutions of Eq. (2) if W (yi, 3 ^ 2 ) = 0. This completes 
the proof of Theorem 3.2.4. 

Theorem 3.2.4 states that, if and only if the Wronskian of yi andy 2 is not everywhere 
zero, then the linear combination c\y\ + C 2 y 2 contains all solutions of Eq. (2). It is 
therefore natural (and we have already done this in the preceding section) to call the 
expression 

y = ciyi(f) + c 2 y 2 (0 

with arbitrary constant coefficients the general solution of Eq. (2). The solutions 
yi and y 2 are said to form a fundamental set of solutions of Eq. (2) if and only if their 
Wronskian is nonzero. 

We can restate the result of Theorem 3.2.4 in slightly different language: to find 
the general solution, and therefore all solutions, of an equation of the form ( 2 ), we 
need only find two solutions of the given equation whose Wronskian is nonzero. 
We did precisely this in several examples in Section 3.1, although there we did not 
calculate the Wronskians. You should now go back and do that, thereby verifying 
that all the solutions we called “general solutions” in Section 3.1 do satisfy the nec¬ 
essary Wronskian condition. Alternatively, the following example includes all those 
mentioned in Section 3.1, as well as many other problems of a similar type. 
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EXAMPLE 

4 


EXAMPLE 

5 


Theorem 3.2.5 


Suppose thatyi® = e nt and y 2 ® = e nt are two solutions of an equation of the form (2). Show 
that they form a fundamental set of solutions if r\ ^ r 2 . 

We calculate the Wronskian of yi and y 2 : 


e nt 

e r 2 ‘ 

rie n ‘ 

ne' 


(r 2 - n)exp[(ri + r 2 )t\. 


Since the exponential function is never zero, and since we are assuming that r 2 — r i / 0, it 
follows that W is nonzero for every value of t. Consequently, yi and y 2 form a fundamental 
set of solutions. 


Show that y\(t) = t 1/2 and y 2 ® = t 1 form a fundamental set of solutions of 

2 t 2 y" + 3ty - y = 0, t > 0. (14) 

We will show how to solve Eq. (14) later (see Problem 34 in Section 3.3). However, at 
this stage we can verify by direct substitution that yi and y 2 are solutions of the differential 
equation. Since y[(t) = \t~ l/2 and//® = — ^ -3/2 ,we have 

21 2 (—|r 3/2 ) + 3*(§r 1 ' 2 ) - t x < 2 = (-§ + §- i)t 1/2 = o. 

Similarly,y/t) = ~t~ 2 and y/® = 2r 3 ,so 

2/(2r 3 ) + 3 t(-r 2 ) - r 1 = (4 - 3 - l)r 1 = 0. 


Next we calculate the Wronskian W of yi and y 2 : 

C/ 2 r 1 
±r 1/2 -r 2 


w = 


- _ 3 f—3/2 


(15) 


Since W / 0 for t > 0, we conclude that yi and y 2 form a fundamental set of solutions there. 


In several cases we have been able to find a fundamental set of solutions, and 
therefore the general solution, of a given differential equation. However, this is often 
a difficult task, and the question arises as to whether a differential equation of the 
form (2) always has a fundamental set of solutions. The following theorem provides 
an affirmative answer to this question. 


Consider the differential equation (2), 

L[y ] = y" +p(t)y' + q(t)y = 0, 

whose coefficients p and q are continuous on some open interval I. Choose some 
point to in I. Let yi be the solution of Eq. (2) that also satisfies the initial conditions 

y(t 0 ) = 1 , y'(fo) = 0, 

and let y 2 be the solution of Eq. (2) that satisfies the initial conditions 

y(*o) = 0, y\t 0 ) = 1. 

Then yi and y 2 form a fundamental set of solutions of Eq. (2). 
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First observe that the existence of the functions y\ and y 2 is ensured by the existence 
part of Theorem 3.2.1. To show that they form a fundamental set of solutions, we need 
only calculate their Wronskian at to: 


W(yuy 2 )(t 0 ) 


yi(io) y2(to) 


1 0 

y[(t 0 ) y' 2 (to) 


0 1 


Since their Wronskian is not zero at the point to, the functions yi and y 2 do form a 
fundamental set of solutions, thus completing the proof of Theorem 3.2.5. 

Note that the potentially difficult part of this proof, demonstrating the existence 
of a pair of solutions, is taken care of by reference to Theorem 3.2.1. Note also that 
Theorem 3.2.5 does not address the question of how to find the solutions y\ and y 2 
by solving the specified initial value problems. Nevertheless, it may be reassuring to 
know that a fundamental set of solutions always exists. 


EXAMPLE 

6 


Find the fundamental set of solutions y\ and y 2 specified by Theorem 3.2.5 for the differential 
equation 

f-y = 0 . ( 16 ) 


using the initial point t 0 = 0. 

In Section 3.1 we noted that two solutions of Eq. (16) are yi(t) = e t and y 2 (t) = e~ f . The 
Wronskian of these solutions is W(yi,y 2 )(t) = —2^0, so they form a fundamental set of 
solutions. However, they are not the fundamental solutions indicated by Theorem 3.2.5 because 
they do not satisfy the initial conditions mentioned in that theorem at the point t = 0. 

To find the fundamental solutions specified by the theorem, we need to find the solutions 
satisfying the proper initial conditions. Let us denote by y 3 (t) the solution of Eq. (16) that 
satisfies the initial conditions 


y(0) = 1, /(0) = 0. 


(17) 


The general solution of Eq. (16) is 


y = c\d + c 2 e~\ (18) 

and the initial conditions (17) are satisfied if c\ = 1/2 and c 2 = 1/2. Thus 

y 3 (t) = 1 e l + \e~ l = coshL 


Similarly, if y 4 (t) satisfies the initial conditions 


y(0) - 0, /(0) = 1, 


( 19 ) 


then 


y 4 (0 = \e t —\e 1 = sinhL 


Since the Wronskian of y 2 and y 4 is 


W(y 3 ,y 4 )(t) = cosh 2 t - sinh 2 1 = 1, 
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these functions also form a fundamental set of solutions, as stated by Theorem 3.2.5. Therefore, 
the general solution of Eq. (16) can be written as 

y — k\ cosh t + k 2 sinh t , (20) 

as well as in the form (18). We have used k\ and k 2 for the arbitrary constants in Eq. (20) 
because they are not the same as the constants c\ and c 2 in Eq. (18). One purpose of this 
example is to make it clear that a given differential equation has more than one fundamental 
set of solutions; indeed, it has infinitely many; see Problem 21. As a rule, you should choose 
the set that is most convenient. 


In the next section we will encounter equations that have complex-valued solu¬ 
tions. The following theorem is fundamental in dealing with such equations and their 
solutions. 


Theorem 3.2.6 Consider again the equation (2), 

L\y] = y" + pit)/ + q(t)y = 0, 

where p and q are continuous real-valued functions. If y = u(t) + iv(t) is a complex¬ 
valued solution of Eq. (2), then its real part u and its imaginary part v are also 
solutions of this equation. 


To prove this theorem we substitute u(t) + iv(t) for y in L[y], obtaining 

L[y] = u"(t) + iv"(t) + p(t)[u'(t) + iv'(t)] + q(t)[u(t) + iv(t) ]. (21) 

Then, by separating Eq. (21) into its real and imaginary parts (and this is where we 
need to know that p(t) and q(t) are real-valued), we find that 

L[y] = u"(t ) + p(t)u'(t ) + q(t)u(t) + i[v"(t) + p(t)v'(t) + q(t)v(t)] 

= L[u](t ) + iL[v](t). 

Recall that a complex number is zero if and only if its real and imaginary parts 
are both zero. We know that L[y] = 0 because y is a solution of Eq. (2). Therefore, 
L[u](t) = 0 and L[v](t) = 0 also; consequently, u and v are also solutions of Eq. (2), 
so the theorem is established. We will see examples of the use of Theorem 3.2.6 in 
Section 3.3. 

Incidentally, the complex conjugate y of a solution y is also a solution. This is a 
consequence of Theorem 3.2.2 since y = u(t) — iv(t ) is a linear combination of two 
solutions. 

Now let us examine further the properties of the Wronskian of two solutions 
of a second order linear homogeneous differential equation. The following the¬ 
orem, perhaps surprisingly, gives a simple explicit formula for the Wronskian of 
any two solutions of any such equation, even if the solutions themselves are not 
known. 
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Theorem 3.2.7 


(Abel’s Theorem ) 4 

If y\ and y 2 are solutions of the differential equation 

L[y] = y" + p(t)y' + q(t)y = 0, (22) 


where p and q are continuous on an open interval /, then the Wronskian W(y \, y 2 ) (0 
is given by 


W(yuy 2 )(t) = cexp 



(23) 


where c is a certain constant that depends on y\ and y 2, but not on t. Further, 
W(yi,y 2 )(0 either is zero for all tin / (if c = 0) or else is never zero in / (if c 7^ 0). 


To prove Abel’s theorem, we start by noting that y\ and y 2 satisfy 

y" +p(t)y[ + q(t)yi = 0 , 
y'2 +p(t)y' 2 + q(t)y2 = 0 . 

If we multiply the first equation by —y 2 , multiply the 
resulting equations, we obtain 

(yiy'i - yfo) +p(t)(yiy' 2 - y'\yi) 

Next, we let W{t) — W(yi,y 2 )(t) and observe that 

w 1 =y 1 y r '-y"y 2 . (26) 

Then we can write Eq. (25) in the form 

W' + p(t)W = 0. (27) 


(24) 

second by yi, and add the 
= 0. (25) 


Equation (27) can be solved immediately since it is both a first order linear equation 
(Section 2.1) and a separable equation (Section 2.2). Thus 


W (t) = c exp 



p(t)dt , 


(28) 


where c is a constant. The value of c depends on which pair of solutions of Eq. (22) 
is involved. However, since the exponential function is never zero, W(t) is not 
zero unless c = 0, in which case W (, t ) is zero for all t. This completes the proof of 
Theorem 3.2.7. 

Note that the Wronskians of any two fundamental sets of solutions of the same dif¬ 
ferential equation can differ only by a multiplicative constant, and that the Wronskian 
of any fundamental set of solutions can be determined, up to a multiplicative constant, 


4 The result in Theorem 3.2.7 was derived by the Norwegian mathematician Niels Henrik Abel (1802- 
1829) in 1827 and is known as Abel’s formula. Abel also showed that there is no general formula for 
solving a quintic, or fifth degree, polynomial equation in terms of explicit algebraic operations on the 
coefficients, thereby resolving a question that had been open since the sixteenth century. His greatest 
contributions, however, were in analysis, particularly in the study of elliptic functions. Unfortunately, his 
work was not widely noticed until after his death. The distinguished French mathematician Legendre 
called it a “monument more lasting than bronze.” 
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EXAMPLE 

7 


PROBLEMS 


without solving the differential equation. Further, since under the conditions of The¬ 
orem 3.2.7 the Wronskian W is either always zero or never zero, you can determine 
which case actually occurs by evaluating W at any single convenient value of t. 


In Example 5 we verified that y\(t) = t 1/2 and y 2 (t) = t 1 are solutions of the equation 

2 t 2 y" + 3ty' - y = 0, t > 0. (29) 


Verify that the Wronskian of yi and y 2 is given by Eq. (23). 

From the example just cited we know that W(yi,y 2 )(t) = —(3/2 )t~ 3/2 . To use Eq. (23), we 
must write the differential equation (29) in the standard form with the coefficient of y" equal 
to 1. Thus we obtain 


y " + Yt y, -^ y = 0 ’ 


so p{t) = 3/2f. Hence 


Wiyuy^it) = c exp 





= cr 3 * * * 7 8 9 10 / 2 . 


(30) 


Equation (30) gives the Wronskian of any pair of solutions of Eq. (29). For the particular 
solutions given in this example, we must choose c = —3/2. 


Summary. We can summarize the discussion in this section as follows: to find the 
general solution of the differential equation 

/ + P(t)y' + q(t)y = 0, a <t < p, 

we must first find two functions y\ and y 2 that satisfy the differential equation in 
a < t < p. Then we must make sure that there is a point in the interval where the 
Wronskian W of yi and y 2 is nonzero. Under these circumstances yi and y 2 form a 
fundamental set of solutions, and the general solution is 

y = ciyi(t) + c 2 y 2 (0, 

where ci and C 2 are arbitrary constants. If initial conditions are prescribed at a point 
in a < t < p, then c\ and C2 can be chosen so as to satisfy these conditions. 


In each of Problems 1 through 6, find the Wronskian of the given pair of functions. 

1. e 2t , e~ 3t/2 2. cos£, shU 

3. e~ 2t , te~ 2t 4. x, xe x 

5. e r shu, Pcost 6. cos 2 0, 1 + cos 20 

In each of Problems 7 through 12, determine the longest interval in which the given initial 

value problem is certain to have a unique twice-differentiable solution. Do not attempt to find 

the solution. 

7. ty" + 3 y = t, y( 1) = 1, /(1) = 2 

8. (t — 1 )y" — 3 ty' + 4y = sku, y(-2) = 2, y'(— 2) = 1 

9. t{t - 4)/' + 3 ty + 4y = 2, y(3) = 0, /(3) = -1 

10. y" + (cos t)y' + 3(ln \t\)y = 0, y(2) = 3, /(2) = 1 
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11 . (x - 3 )y" + xy' + (In \x\)y = 0 , y(l) = 0 , /( 1 ) = 1 

12. (x - 2 )y" + / + (x - 2) (tanx)y = 0, y(3) = 1, y'(3) = 2 

13. Verify that y\(t) = t 2 and y 2 (0 = t~ l are two solutions of the differential equation 

t 2 y" — 2y = 0 for t > 0. Then show that y = cpt 2 + c 2 t~ x is also a solution of this equation 

for any c\ and c 2 . 

14. Verify that y 3 (t) = 1 and y 2 (t) = t 1/2 are solutions of the differential equation 

yy" + (yO 2 = o for t > 0. Then show that y = c\ + c 2 t 1/2 is not, in general, a solution of this 
equation. Explain why this result does not contradict Theorem 3.2.2. 

15. Show that if y = (p(t) is a solution of the differential equation y" + p(t)y' + q(t)y = g(t ), 
where g{t ) is not always zero, then y = c 0 (t), where c is any constant other than 1 , is not a 
solution. Explain why this result does not contradict the remark following Theorem 3.2.2. 

16. Can y = sin(t 2 ) be a solution on an interval containing t = 0 of an equation 
y" + p(t)y' + q(t)y = 0 with continuous coefficients? Explain your answer. 

17. If the Wronskian W of f and g is 3e 4t , and if fit) = e 2t , find g(t). 

18. If the Wronskian W of f and g is t 2 e\ and if fit) = t , find g{t). 

19. If W(f, g) is the Wronskian of / and g, and if u = 2f — g, v = f + 2g, find the Wronskian 
W(u , if) of u and v in terms of W(f,g). 

20. If the Wronskian of / and g is t cos t — sin t, and if u = f + 3g, v = f — g, find the 
Wronskian of u and v. 

21. Assume thatyi andy 2 are a fundamental set of solutions of y" + p(t)y' + q(t)y = 0 and let 
y 3 = apy\ + a 2 y 2 andy 4 = bpy\ + 6 2 y 2 , where a\,a 2 ,b\, and b 2 are any constants. Show that 

W(y 3 ,y 4 ) = {a x b 2 - a 2 bi)W(y u y 2 ). 

Are ^3 and y 4 also a fundamental set of solutions? Why or why not? 

In each of Problems 22 and 23, find the fundamental set of solutions specified by Theorem 
3.2.5 for the given differential equation and initial point. 

22 . y" + y' — 2y = 0 , t {) = 0 

23. y" + 4/ + 3y = 0, t 0 = 1 

In each of Problems 24 through 27, verify that the functions y\ and y 2 are solutions of the given 
differential equation. Do they constitute a fundamental set of solutions? 

24. y" + 4y = 0; yi(t) = cos2 1, y 2 (t) = sin2 1 

25. y” -2y'+y = 0; y^t) = e‘, y 2 (t) = te‘ 

26. x 2 y" — x(x + 2)y' + (x + 2)y = 0 , x > 0 ; yi(x) = x, y 2 (x) = xe* 

27. (1 — xcot x)y" — xy' + y = 0, 0 < x < tt; y\{x) = x, y 2 (x) = sinx 

28. Consider the equation y" — y' — 2y = 0. 

(a) Show that y\{t) = e~ l and y 2 (t) = e 2t form a fundamental set of solutions. 

(b) Let y 3 (t ) = -2e 2t , y 4 (t) = y\{t) + 2 y 2 (t), and y 5 (t) = 2y x {t) - 2y 3 (t). Are y 3 (t), y 4 (t), 
and y 5 (t) also solutions of the given differential equation? 

(c) Determine whether each of the following pairs forms a fundamental set of solutions: 

[y 1 (0, y3 (01; \yi (0, y3 (01; [yi (0, y* (01; [y* (0, ys (01 ■ 

In each of Problems 29 through 32, find the Wronskian of two solutions of the given differential 
equation without solving the equation. 

29. t 2 y" — t(t + 2)y' + (t + 2)y = 0 30. (cos t)y" + (sin t)y' — ty = 0 

31. x 2 y" + xy' + (x 2 — v 2 )y = 0, Bessel’s equation 

32. (1 — x 2 )/ 7 — 2xy' + a{a + 1 )y = 0, Legendre’s equation 
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33. Show that if p is differentiable and p(t) > 0, then the Wronskian W(t) of two solutions of 
\p(t)y']' + q(t)y = 0 is W(t) = c/p(t), where c is a constant. 

34. If the differential equation ty" + 2y' + te f y = 0 has y\ and y 2 as a fundamental set of 
solutions and if W(yi,y 2 )(l) = 2, find the value of W(yi,y2)(5). 

35. If the differential equation t 2 y" — 2y' + (3 + t)y = 0 has y\ and y 2 as a fundamental set of 
solutions and if W(y 1 ,y 2 )(2) = 3, find the value ofW(yi,y 2 )(4). 

36. If the Wronskian of any two solutions of y" + p(t)y' + q{t)y = 0 is constant, what does this 
imply about the coefficients p and ql 

37. If /, g, and h are differentiable functions, show that W ( fg,fh ) = f 2 W(g , h). 

In Problems 38 through 40, assume that p and q are continuous and that the functions y\ and 

y 2 are solutions of the differential equation y" + p(t)y' + q{t)y = 0 on an open interval I. 

38. Prove that if yi and y 2 are zero at the same point in /, then they cannot be a fundamental 
set of solutions on that interval. 

39. Prove that if yi and y 2 have maxima or minima at the same point in /, then they cannot 
be a fundamental set of solutions on that interval. 

40. Prove that if yi and y 2 have a common point of inflection t 0 in /, then they cannot be a 
fundamental set of solutions on I unless both p and q are zero at t 0 . 

41. Exact Equations. The equation 

P{x)y" + Q{x)y' + R{x)y = 0 
is said to be exact if it can be written in the form 

[P(x)?]' + [f(x)yY = 0, 

where f(x) is to be determined in terms of P(x), Q(x ), and R(x). The latter equation can 
be integrated once immediately, resulting in a first order linear equation for y that can be 
solved as in Section 2.1. By equating the coefficients of the preceding equations and then 
eliminating/(x), show that a necessary condition for exactness is 

P"(x) - Q'(x ) + R(x) = 0. 

It can be shown that this is also a sufficient condition. 

In each of Problems 42 through 45, use the result of Problem 41 to determine whether the 

given equation is exact. If it is, then solve the equation. 

42. y" + xy' + y = 0 43. y" + 3 x 2 y’ + xy = 0 

44. xy" — (cos*)/ + (sinx)y = 0, x > 0 45. x 2 y" +xy' —y = 0, x > 0 

46. The Adjoint Equation. If a second order linear homogeneous equation is not exact, it can 
be made exact by multiplying by an appropriate integrating factor /x(x). Thus we require 
that /r(x) be such that 


p{x)P{x)y" + p{x)Q(x)y r + p{x)R{x)y = 0 
can be written in the form 


[/x(x)P(x)/] / + [f(x)y]' = 0. 

By equating coefficients in these two equations and eliminating /(x), show that the 
function /x must satisfy 


P p" + (2 P' — Q)n' + {P" — Q' + R)p< — 0. 
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This equation is known as the adjoint of the original equation and is important in 
the advanced theory of differential equations. In general, the problem of solving the 
adjoint differential equation is as difficult as that of solving the original equation, so only 
occasionally is it possible to find an integrating factor for a second order equation. 

In each of Problems 47 through 49, use the result of Problem 46 to find the adjoint of the given 

differential equation. 

47. x 2 y" + xy' + (x 2 — v 2 )y = 0, Bessel’s equation 

48. (1 — x 2 )y" — 2xy' + a{a + 1 )y = 0, Legendre’s equation 

49. y" — xy = 0, Airy’s equation 

50. For the second order linear equation P(x)y" + Q(x)y’ + 7?(x)y = 0, show that the adjoint 
of the adjoint equation is the original equation. 

51. A second order linear equation P{x)y" + Q(x)y r + 7?(x)y = 0 is said to be self-adjoint if 
its adjoint is the same as the original equation. Show that a necessary condition for this 
equation to be self-adjoint is that P'(x) = Q(x). Determine whether each of the equations 
in Problems 47 through 49 is self-adjoint. 


3.3 Complex Roots of the Characteristic Equation 

We continue our discussion of the equation 

ay" + by' + cy = 0, (1) 

where a, b, and c are given real numbers. In Section 3.1 we found that if we seek 
solutions of the form y = e rt , then r must be a root of the characteristic equation 

ar 2 + br + c = 0 . ( 2 ) 

We showed in Section 3.1 that if the roots r\ and r 2 are real and different, which 
occurs whenever the discriminant b 2 — 4 ac is positive, then the general solution of 
Eq. (1) is 

y = cie rit + c 2 e r2t . (3) 

Suppose now that b 2 — 4 ac is negative. Then the roots of Eq. (2) are conjugate 
complex numbers; we denote them by 

r\ = A + ifi , r 2 = A — ifi , (4) 

where A and /i are real. The corresponding expressions for y are 

yi(t) = exp [(A + ifi)t], y 2 (t) = exp[(A - i/i)t]. (5) 

Our first task is to explore what is meant by these expressions, which involve 
evaluating the exponential function for a complex exponent. For example, if 
A = —1 ,11 — 2, and t = 3, then from Eq. (5), 

—3+6* 


yi( 3) = e 


( 6 ) 
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What does it mean to raise the number e to a complex power? The answer is provided 
by an important relation known as Euler’s formula. 


Euler's Formula. To assign a meaning to the expressions in Eqs. (5), we need to give 
a definition of the complex exponential function. Of course, we want the definition 
to reduce to the familiar real exponential function when the exponent is real. There 
are several ways to discover how this extension of the exponential function should 
be defined. Here we use a method based on infinite series; an alternative is outlined 
in Problem 28. 

Recall from calculus that the Taylor series for e l about t = 0 is 

°° 

e r = ^ — , —oo < t < oo. (7) 

n —0 ^ 

If we now assume that we can substitute it for t in Eq. (7), then we have 


e 


it 


oo 


E 

n —0 


(it) n 

n\ 


= E 


Uf2n 


n =0 


(-m 

(2 n)\ 


+ ‘T 


n =1 


(2n — 1)! 


( 8 ) 


where we have separated the sum into its real and imaginary parts, making use of the 
fact that i 2 = —1, i 3 = — i 4 = 1, and so forth. The first series in Eq. (8) is precisely 
the Taylor series for cos t about t = 0, and the second is the Taylor series for sin t 
about t = 0. Thus we have 


e lt = cos t + isint. 


( 9 ) 


Equation (9) is known as Euler’s formula and is an extremely important mathematical 
relationship. Although our derivation of Eq. (9) is based on the unverified assumption 
that the series (7) can be used for complex as well as real values of the independent 
variable, our intention is to use this derivation only to make Eq. (9) seem plausible. 
We now put matters on a firm foundation by adopting Eq. (9) as the definition of e lt . 
In other words, whenever we write e lt , we mean the expression on the right side of 
Eq. (9). 

There are some variations of Euler’s formula that are also worth noting. If we 
replace t by —t in Eq. (9) and recall that cos(— t) = cost and sin(— t) = — sint, then 
we have 

e~ lt = cos t — i sin t. (10) 


Further, if t is replaced by /it in Eq. (9), then we obtain a generalized version of 
Euler’s formula, namely, 

e lllt = cos /it + i sin /it. (11) 


Next, we want to extend the definition of the exponential function to arbitrary 
complex exponents of the form (k + i/i)t. Since we want the usual properties 
of the exponential function to hold for complex exponents, we certainly want 
exp[(A. + i/i)t] to satisfy 

e {k+i/l)t = e u e iflt . ( 12 ) 
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Then, substituting for e 1 ^ from Eq. (11), we obtain 

_ £^( CO s lit + / sin /it) 

= e kt cos /it + ie kt sin /it. (13) 

We now take Eq. (13) as the definition of exp[(A. + i/i)t]. The value of the exponential 
function with a complex exponent is a complex number whose real and imaginary 
parts are given by the terms on the right side of Eq. (13). Observe that the real 
and imaginary parts of exp[(A, + i/i)t] are expressed entirely in terms of elementary 
real-valued functions. For example, the quantity in Eq. (6) has the value 

e-3+6*- = g-3 cos 6 + ie -?> Sin 6 = 0.0478041 - 0.0139113/. 

With the definitions (9) and (13), it is straightforward to show that the usual laws of 
exponents are valid for the complex exponential function. You can also use Eq. (13) 
to verify that the differentiation formula 

d -(e n ) = re n (14) 

dt 


holds for complex values of r. 


EXAMPLE 

1 


Find the general solution of the differential equation 

y" + / + 9.25y = 0, 
Also find the solution that satisfies the initial conditions 

y(0) = 2, /(0) = 8, 


and draw its graph. 

The characteristic equation for Eq. (15) is 

r 2 + r + 9.25 = 0 


so its roots are 

r\ — — | + 3/, r 2 = — \ — 3/. 


Therefore, two solutions of Eq. (15) are 


y r (t) = exp^— 1 + 3/^tj = e 1/2 (cos 3t + zsin 30 

and 

y 2 (t) = exp^— 1 — 3/^tj = e~ t/2 (cos31 — / sin 30- 


(15) 


(16) 


(17) 

(18) 


You can verify that the Wronskian W(yi,y 2 )(t) = —6 ie~ l , which is not zero, so the general 
solution of Eq. (15) can be expressed as a linear combination of y\(t) and y 2 (t) with arbitrary 
coefficients. 

However, the initial value problem (15), (16) has only real coefficients, and it is often 
desirable to express the solution of such a problem in terms of real-valued functions. 
To do this we can make use of Theorem 3.2.6, which states that the real and imaginary parts of 
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a complex-valued solution of Eq. (15) are also solutions of Eq. (15). Thus, starting from either 
y\{t) ory 2 (t), we obtain 

u(t) = e~ t/2 cos3t, v(t) = e~ t/2 sin3t (19) 

as real-valued solutions 5 of Eq. (15). On calculating the Wronskian of u{t) and v(t), we find 
that W ( u , v)(t) = 3e~\ which is not zero; thus u(t) and v(t) form a fundamental set of solutions, 
and the general solution of Eq. (15) can be written as 

y = C \u(t) + C 2 v(t) = e~ tl2 {c\ cos 3 1 + C 2 sin 3 1), (20) 

where C\ and c 2 are arbitrary constants. 

To satisfy the initial conditions (16), we first substitute t = 0 and y = 2 in Eq. (20) with the 
result that c\ — 2. Then, by differentiating Eq. (20), setting t = 0, and setting y' — 8, we obtain 
— \c\ +3c 2 = 8, so that c 2 = 3. Thus the solution of the initial value problem (15), (16) is 

y = e~ t/2 (2co$3t + 3 sin 30- (21) 

The graph of this solution is shown in Figure 3.3.1. 

From the graph we see that the solution of this problem is a decaying oscillation. The sine 
and cosine factors control the oscillatory nature of the solution, and the negative exponential 
factor in each term causes the magnitude of the oscillations to diminish as time increases. 



10 t 


FIGURE 3.3.1 Solution of the initial value problem (15), (16): 
y" + y + 9.25y = 0, y(0) = 2, /(0) = 8. 


Complex Roots; The General Case. The functions y\{t) and y 2 (t), given by Eqs. (5) and 
with the meaning expressed by Eq. (13), are solutions of Eq. (1) when the roots of 
the characteristic equation (2) are complex numbers k ± ip. However, the solutions 
y\ and y 2 are complex-valued functions, whereas in general we would prefer to have 


5 If you are not completely sure that u(t) and v(t) are solutions of the given differential equation, you 
should substitute these functions into Eq. (15) and confirm that they satisfy it. 
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real-valued solutions because the differential equation itself has real coefficients. Just 
as in Example 1, we can use Theorem 3.2.6 to find a fundamental set of real-valued 
solutions by choosing the real and imaginary parts of either y\(t) or y 2 (t). In this way 
we obtain the solutions 

u(t) = e kt cos ixt, v(t) = e xt sin fit. (22) 

By direct computation you can show that the Wronskian of u and v is 

W(u, v)(t) = fie 2kt . (23) 

Thus, as long as /i ^ 0, the Wronskian W is not zero, so u and v form a fundamental 
set of solutions. (Of course, if /x = 0, then the roots are real and the discussion in this 
section is not applicable.) Consequently, if the roots of the characteristic equation 
are complex numbers k ± ifi, with \i ^ 0, then the general solution of Eq. (1) is 

y = c\e kt cos fit + C 2 e kt sin fit, (24) 

where c\ and are arbitrary constants. Note that the solution (24) can be written 
down as soon as the values of k and \i are known. Let us now consider some further 
examples. 


Find the solution of the initial value problem 

EXAMPLE 

2 16 y" - 8/ + 145y = 0, y(0) = -2, /(0) = 1. (25) 

The characteristic equation is 16r 2 — 8r + 145 = 0 and its roots are r — 1/4 ± 3 i. Thus the 
general solution of the differential equation is 

y = c\e t/A cos 3 1 + c 2 e r/4 sin 3 1. (26) 

To apply the first initial condition, we set t = 0 in Eq. (26); this gives 

y(0) — C\ — -2. 

For the second initial condition, we must differentiate Eq. (26) and then set t = 0. In this way 
we find that 

y'(0) = \c x + 3 c 2 = l, 

from which c 2 = 1/2. Using these values of c\ and c 2 in Eq. (26), we obtain 

y = —2e t/A cos 3 1 + \e t,A sin 3 1 (27) 

as the solution of the initial value problem (25). The graph of this solution is shown in 
Figure 3.3.2. 

In this case we observe that the solution is a growing oscillation. Again the trigonometric 
factors in Eq. (27) determine the oscillatory part of the solution, while the exponential factor 
(with a positive exponent this time) causes the magnitude of the oscillation to increase with 
time. 
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FIGURE 3.3.2 Solution of the initial value problem (25): 
16y" - 8 1/ + 145 y = 0, y( 0) = -2, /(0) = 1. 


EXAMPLE 

3 


Find the general solution of 

y" + 9.y = 0. (28) 

The characteristic equation is r 2 + 9 = 0 with the roots r = ±3/; thus X = 0 and /x = 3. The 
general solution is 

y — C\ cos 3 1 + c 2 sin 3 1\ (29) 
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note that if the real part of the roots is zero, as in this example, then there is no exponential 
factor in the solution. Figure 3.3.3 shows the graph of two typical solutions of Eq. (28). In each 
case the solution is a pure oscillation whose amplitude is determined by the initial conditions. 
Since there is no exponential factor in the solution (29), the amplitude of each oscillation 
remains constant in time. 


PROBLEMS In each of Problems 1 through 6, use Euler’s formula to write the given expression in the form 
; a + ib. 

1. exp(l + 2i) 2. exp(2 — 3/) 

3. e i7t 4. e 2 - (7l/2)i 

5. 2 1_i 6. 7T~ l+2i 

In each of Problems 7 through 16, find the general solution of the given differential equation. 


7. 


- 2/ + 2y = 0 

8. 

y" - 2y' + 6y = 0 

9. 

/ 

o 

II 

do" 

1 

& 

+ 

10. 

O 

II 

+ 

+ 

X 

11. 

/ 

+ 6y' + 13y = 0 

12. 

o 

II 

+ 

4 

13. 

y" 

4" 2sy' -f- 1.25y = 0 

14. 

o 

II 

1 

& 

+ 

6^ 

15. 

y" 

o 

II 

& 

(N 

+ 

+ 

16. 

y" + 4y' + 6.25y = 0 


In each of Problems 17 through 22, find the solution of the given initial value problem. Sketch 
the graph of the solution and describe its behavior for increasing t. 

17. y" + 4y = 0, y(0) = 0, /(0) = 1 

18. y" + 4 y' + 5y = 0, y(0) = 1, y' (0) = 0 

19. y" — 2 y' + 5y = 0, y(n/ 2) = 0, y f (n/2) = 2 

20. f+y = 0, y(7t/3) = 2, /(tt/3) = -4 

21. /' +/ + 1.25y = 0, y(0) = 3, /(0) = 1 

22. y" + 2 y' + 2y = 0, y(7t/4) = 2, /(tt/4) = —2 

01 23. Consider the initial value problem 


3 u" — u! + 2u = 0, w(0) = 2, u'(0) = 0. 

(a) Find the solution u(t ) of this problem. 

(b) For t > 0, find the first time at which \u(t)\ = 10. 

24. Consider the initial value problem 

5 u" + 2 u' + lu — 0, u( 0) = 2, u\ 0) = 1. 


(a) Find the solution u{t) of this problem. 

(b) Find the smallest T such that \u(t)\ < 0.1 for all t > T. 

01 25. Consider the initial value problem 

y" + 2/ + 6y = 0, y(0) = 2, /(0) = a > 0. 


(a) Find the solution y{t) of this problem. 

(b) Find a such that y = 0 when t = 1. 

(c) Find, as a function of a , the smallest positive value of t for which y = 0. 

(d) Determine the limit of the expression found in part (c) as a oo. 
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y(0) = 1, /(0) = o. 


26. Consider the initial value problem 

y" + 2 ay' + (a 2 + 1 )y = 0, 

(a) Find the solution y(t) of this problem. 

(b) For a = 1 find the smallest T such that \y(t)\ < 0.1 for t > T. 

(c) Repeat part (b) for a = 1/4,1/2, and 2. 

(d) Using the results of parts (b) and (c), plot T versus a and describe the relation between 
T and a. 

27. Show that W ( e xt cos fit, e kt sin fit) = /ie 2xt . 

28. In this problem we outline a different derivation of Euler’s formula. 

(a) Show that yi(t) = cos t and y 2 (t) = sint are a fundamental set of solutions of 
y" + y = 0; that is, show that they are solutions and that their Wronskian is not zero. 

(b) Show (formally) that y = e lt is also a solution of y" + y = 0. Therefore, 

e lt = ci cos t + c 2 sin t (i) 

for some constants c\ and c 2 . Why is this so? 

(c) Set t = 0 in Eq. (i) to show that c\ = 1. 

(d) Assuming that Eq. (14) is true, differentiate Eq. (i) and then set t = 0 to conclude that 
c 2 = i. Use the values of c\ and c 2 in Eq. (i) to arrive at Euler’s formula. 

Using Euler’s formula, show that 

cost = (e lt + e~ lt )/2 , sint = (e lt — e~ lt )/2i. 

If e rt is given by Eq. (13), show that e^ 1+r2)t = e nt e r2t for any complex numbers r\ and r 2 . 
If e rt is given by Eq. (13), show that 


29 


30. 

31. 


dt 

for any complex number r. 

32. Consider the differential equation 

ay" + by' + cy = 0, 

where b 2 — 4ac < 0 and the characteristic equation has complex roots X±ifi. Substitute 
the functions 

u(t) = e xt cos fit and v(t) = e kt sin fit 

for y in the differential equation and thereby confirm that they are solutions. 

33. If the functions y\ and y 2 are a fundamental set of solutions of y" + p(t)y' + q(t)y = 0, 
show that between consecutive zeros of yi there is one and only one zero of y 2 . Note 
that this result is illustrated by the solutions yi(t) = cos t and y 2 (t) = sin t of the equation 
y" + y = 0. 

Hint: Suppose that t\ and t 2 are two zeros of y\ between which there are no zeros of y 2 . 
Apply Rolle’s theorem to y\/y 2 to reach a contradiction. 


Change of Variables. Sometimes a differential equation with variable coefficients, 

y" + p{t)y' + q(t)y = 0, 


(i) 


can be put in a more suitable form for finding a solution by making a change of the independent 
variable. We explore these ideas in Problems 34 through 46. In particular, in Problem 34 we 
show that a class of equations known as Euler equations can be transformed into equations 
with constant coefficients by a simple change of the independent variable. Problems 35 through 
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42 are examples of this type of equation. Problem 43 determines conditions under which the 
more general Eq. (i) can be transformed into a differential equation with constant coefficients. 
Problems 44 through 46 give specific applications of this procedure. 

34. Euler Equations. An equation of the form 

t 2 U +at dt +f,y= °’ t>o ' (ii) 

where a and /3 are real constants, is called an Euler equation. 

(a) Let x = In t and calculate dy/dt and d 2 y/dt 2 in terms of dy/dx and d 2 y/dx 2 . 

(b) Use the results of part (a) to transform Eq. (ii) into 

gp> 

Observe that Eq. (iii) has constant coefficients. If yi(x) and y 2 (x) form a fundamental set 
of solutions of Eq. (iii), then yi(lnt) and y 2 (lnt) form a fundamental set of solutions of 
Eq. (ii). 


In each of Problems 35 through 42, use the method of Problem 34 to solve the given equation 
for t > 0. 

t 2 y" + ty' + y = 0 36. t 2 y" + 4 ty' + 2y = 0 

t 2 y" + 3 ty' + 1.25y = 0 38. t 2 y" - 4 ty' - 6y = 0 

t 2 y " - 4 ty' + 6y = 0 40. t 2 y" — ty’ + 5y = 0 

t 2 y" + 3 ty' - 3y = 0 42. t 2 y" + Ity' + lOy = 0 


35 

37 

39 

41 


43. In this problem we determine conditions on p and g that enable Eq. (i) to be transformed 
into an equation with constant coefficients by a change of the independent variable. Let 
x = u(t) be the new independent variable, with the relation between x and t to be specified 
later. 

(a) Show that 

dy dx dy d 2 y / dx\ 2 d 2 y d 2 x dy 

dt dt dx ’ dt 2 \dt) dx 2 dt 2 dx 


(b) Show that the differential equation (i) becomes 


/ dx\ 2 d 2 y 
\dt) dx 2 + 


/ d 2 x 

ydi 2 


, x dx 
+P(t) dt 


dy 

dx 


+ q(t)y = 0. 


(iv) 


(c) In order for Eq. (iv) to have constant coefficients, the coefficients of d 2 y/dx 2 and of 
y must be proportional. If q(t) > 0, then we can choose the constant of proportionality to 
be 1; hence 

x = u(t ) = J [q(t)] 1/2 dt. (v) 

(d) With x chosen as in part (c), show that the coefficient of dy I dx in Eq. (iv) is also a 
constant, provided that the expression 


q\t) + 2 p(t)q(t) 
2 lq{t)W 


(vi) 


is a constant. Thus Eq. (i) can be transformed into an equation with constant coefficients 
by a change of the independent variable, provided that the function (< q r + 2 pq)/q }3/2 is a 
constant. How must this result be modified if q(t) < 0? 
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In each of Problems 44 through 46, try to transform the given equation into one with constant 
coefficients by the method of Problem 43. If this is possible, find the general solution of the 
given equation. 

44. y" + ty' + e~ f2 y = 0, —oo < t < oo 

45. y" + 3 ty' + t 2 y = 0, —oo < t < oo 

46. ty" + ( t 2 — 1 )y r + t 3 y = 0, 0 < t < oo 


3.4 Repeated Roots; Reduction of Order 

In earlier sections we showed how to solve the equation 

ay" + by' + cy = 0 (1) 

when the roots of the characteristic equation 

ar 2 + br + c = 0 (2) 

either are real and different or are complex conjugates. Now we consider the third 
possibility, namely, that the two roots r\ and r 2 are equal. This case is transitional 
between the other two and occurs when the discriminant b 2 — Aac is zero. Then it 
follows from the quadratic formula that 

n = r 2 = —b/la. (3) 

The difficulty is immediately apparent; both roots yield the same solution 

yi (t) = e~ bt ' 2a (4) 

of the differential equation (1), and it is not obvious how to find a second solution. 


Solve the differential equation 

EXAMPLE y" -f 4/ -f 4y = 0. (5) 

^ The characteristic equation is 

r 2 + 4r + 4 = (r + 2) 2 = 0, 

so r\ = r 2 = —2. Therefore, one solution of Eq. (5) is y\{t) = e~ 2t . To find the general solution 
of Eq. (5), we need a second solution that is not a constant multiple of jq. This second solution 
can be found in several ways (see Problems 20 through 22); here we use a method originated 
by D’Alembert 6 in the eighteenth century. Recall that since y\(t) is a solution of Eq. (1), so is 
cy\(t) for any constant c. The basic idea is to generalize this observation by replacing c by a 


6 Jean d’Alembert (1717-1783), a French mathematician, was a contemporary of Euler and Daniel 
Bernoulli and is known primarily for his work in mechanics and differential equations. D’Alembert’s 
principle in mechanics and d’Alembert’s paradox in hydrodynamics are named for him, and the wave 
equation first appeared in his paper on vibrating strings in 1747. In his later years he devoted himself 
primarily to philosophy and to his duties as science editor of Diderot’s Encyclopedic. 
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function v(t) and then trying to determine v(t) so that the product v(i)y\(t) is also a solution 
of Eq. (1). 

To carry out this program, we substitute y = v(t)y\(t) in Eq. (5) and use the resulting equation 
to find v(t). Starting with 

y = v{t)yi{t) = v(t)e~ 2 ‘, (6) 


we have 


y' — v\t)e 2t - 2v{t)e 2t 


(7) 


and 


y" — v"{t)e 2t — 4v'{t)e 2t + 4 v(t)e 2t . 


( 8 ) 


By substituting the expressions in Eqs. (6), (7), and (8) in Eq. (5) and collecting terms, we 
obtain 


[v"(t) - 4v'(t) + 4 v(t) + 4 v'(t) - 8 v(t) + 4v(t)]e~ 2t = 0, 


which simplifies to 


Therefore, 


and 


v"(t) = 0. 
v'(t) = Ci 
y(t) = C\t + c 2 , 


(9) 


( 10 ) 


where c\ and c 2 are arbitrary constants. Finally, substituting for v(t ) in Eq. (6), we obtain 

y = c\te~ 2t + c 2 e~ 2t . (11) 

The second term on the right side of Eq. (11) corresponds to the original solution 
y 1 (t) = exp(—2 1), but the first term arises from a second solution, namely, y 2 {t) = texp(— 2t). 
We can verify that these two solutions form a fundamental set by calculating their Wronskian: 


W(y u y 2 )(t) = 


e “ 
—2e~ 2t 


te~ Al 

(1 - 2 i)e~ 2t 


-2te- 4t + 2te- 4t = e~ 4t ^0. 


Therefore, 

yi(t) = c“ 2r , y 2 (t) = te~ 2t (12) 

form a fundamental set of solutions of Eq. (5), and the general solution of that equation is given 
by Eq. (11). Note that both yi(t) and y 2 (t) tend to zero as t -> oo; consequently, all solutions 
of Eq. (5) behave in this way. The graph of a typical solution is shown in Figure 3.4.1. 


y 

2 




JL 


L 




0.5 1 1.5 2 t 

FIGURE 3.4.1 A typical solution of Eq. (5): y" + 4 y' + 4y = 0. 
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The procedure used in Example 1 can be extended to a general equation whose 
characteristic equation has repeated roots. That is, we assume that the coefficients in 
Eq. (1) satisfy b 2 — 4 ac = 0, in which case 

yi (t) = e~ bt/2a 


is a solution. To find a second solution, we assume that 

y = v(t)yi(t) = v(t)e~ bt/2a 

and Substitute V in Pn (\ ^ tr» HpU^rmirip* d (t\ \A/p» Vi c\ 


and 

Then. 


y = w)y uu = 

y in Eq. (1) to determine v(t). We have 

/ = v'{t)e~ b,/2a - —v(t)e~ bt/2a 
2 a 


y" = v"(t)e~ bt/2a b 
a 


l, by substituting in Eq. (1) 


v'(t)e~ bt/2a + ^v(t)e~ b,/2a . 


(13) 

(14) 

(15) 


(16) 


Canceling the factor exp(—bt/2a), which is nonzero, and rearranging the remaining 
terms, we find that 


av"(£) T (—b T b~)v f it) T 




v(t) = 0. 


(17) 


The term involving v'(t) is obviously zero. Further, the coefficient of v(t) is 
c — (b 2 /4a), which is also zero because b 2 — 4ac = 0 in the problem that we are 
considering. Thus, just as in Example 1, Eq. (17) reduces to 


v"(t) = 0, 


so 

v{t) = Cl + C 2 t. 


Hence, from Eq. (13), we have 

y = c 1 e~ b,/2a + c 2 te- b,/2a . 

Thus y is a linear combination of the two solutions 

yi(f) = e~ bt/2a , y 2 (t) = te~ bt/2a . 


The Wronskian of these two solutions is 


W(y u y 2 )U) = 


0 -btj2a 


_ p —bt/2a 

2 a 


1 - 


te~ bt/2a 

bt 
2 a 


e -bt/2a 


= e~ bt/a . 


(18) 

(19) 


( 20 ) 


Since W(yi,y 2 )(t) is never zero, the solutions y\ and y 2 given by Eq. (19) are a 
fundamental set of solutions. Further, Eq. (18) is the general solution of Eq. (1) 
when the roots of the characteristic equation are equal. In other words, in this case 
there is one exponential solution corresponding to the repeated root and a second 
solution that is obtained by multiplying the exponential solution by t. 
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EXAMPLE 

2 


Find the solution of the initial value problem 

y" — / + 0.25y = 0, y(0) = 2, /(0) = (21) 

The characteristic equation is 

r 2 - r + 0.25 = 0, 

so the roots are = r 2 = 1/2. Thus the general solution of the differential equation is 

y = cW 2 + c 2 te l/2 . (22) 

The first initial condition requires that 

y(0) = ci = 2. 

To satisfy the second initial condition, we first differentiate Eq. (22) and then set t = 0. This 
gives 

y (0) = \ci +c 2 = j , 

so c 2 = —2/3. Thus the solution of the initial value problem is 

y = 2e' /2 - | te" 2 . (23) 

The graph of this solution is shown by the blue curve in Figure 3.4.2. 



FIGURE 3.4.2 Solutions of y" — y' + 0.25y = 0, y(0) = 2, with 
y(0) = 1/3 (blue curve) and withy'(0) = 2 (black curve), respectively. 


Let us now modify the initial value problem (21) by changing the initial slope; to be specific, 
let the second initial condition be /(0) = 2. The solution of this modified problem is 

y = 2e t/2 + te t/2 , 

and its graph is shown by the black curve in Figure 3.4.2. The graphs shown in this figure suggest 
that there is a critical initial slope, with a value between | and 2, that separates solutions that 
grow positively from those that ultimately grow negatively. In Problem 16 you are asked to 
determine this critical initial slope. 
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The geometrical behavior of solutions is similar in this case to that when the 
roots are real and different. If the exponents are either positive or negative, then 
the magnitude of the solution grows or decays accordingly; the linear factor t has 
little influence. A decaying solution is shown in Figure 3.4.1 and growing solutions in 
Figure 3.4.2. However, if the repeated root is zero, then the differential equation is 
y" = 0 and the general solution is a linear function of t. 

Summary. We can now summarize the results that we have obtained for second order 
linear homogeneous equations with constant coefficients 

ay" + by' + cy = 0. (1) 

Let r\ and r 2 be the roots of the corresponding characteristic equation 

ar 2 + br + c = 0 . ( 2 ) 

If r\ and r 2 are real but not equal, then the general solution of the differential 
equation ( 1 ) is 

y = cie nt + c 2 e rit . (24) 

If r\ and r 2 are complex conjugates X ± ifi, then the general solution is 

y = c\e u cos fit + c 2 e xt sin fit. (25) 

If n = r 2 , then the general solution is 

y = Cl e rit + c 2 te rit . (26) 

Reduction of Order. It is worth noting that the procedure used in this section for equa¬ 
tions with constant coefficients is more generally applicable. Suppose that we know 
one solution y\(t ), not everywhere zero, of 

f + p(t)y' + q(t)y = 0 . (27) 

To find a second solution, let 

y = K0yi(0; (28) 

then 

/ = v'(t)yi(t) + v(t)y[(t) 

and 

y" = v"(t)y 1 (t) + 2v'(t)y[(t) + v(t)y”(t). 

Substituting for y, y and y" in Eq. (27) and collecting terms, we find that 

yiv" + (2yi + pyi)v' + iy'[ + py[ + qyi)v = 0. (29) 

Since y\ is a solution of Eq. (27), the coefficient of v in Eq. (29) is zero, so that Eq. (29) 
becomes 


yiv" + ( 2 y[ +pyi)v' = 0 . 


( 30 ) 
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EXAMPLE 

3 


PROBLEMS 


Despite its appearance, Eq. (30) is actually a first order equation for the function v' 
and can be solved either as a first order linear equation or as a separable equation. 
Once v' has been found, then v is obtained by an integration. Finally, y is determined 
from Eq. (28). This procedure is called the method of reduction of order, because the 
crucial step is the solution of a first order differential equation for v' rather than 
the original second order equation for y. Although it is possible to write down a 
formula for v(t), we will instead illustrate how this method works by an example. 


Given that yi (t) = t~ x is a solution of 

2 t 2 y" + 3 ty r — y = 0, t > 0, (31) 

find a fundamental set of solutions. 

We set y = then 

y' = v'r 1 — vt~ 2 , y" = v"t~ l — 2 v't~ 2 + 2 vt~ 3 . 

Substituting for y,y', and y" in Eq. (31) and collecting terms, we obtain 

2t 2 (i)"t~ x — 2ih~ 2 + 2 vt~ 3 ) + 3 — vt~ 2 ) — vt~ l 

= 2tv" + (-4 + 3)v r + (4r 1 - 3r 1 - t~ x )v 
= 2tv" - v' = 0. (32) 

Note that the coefficient of v is zero, as it should be; this provides a useful check on our algebraic 
calculations. 

If we let w = i/, then Eq. (32) becomes 


2 tw' — w = 0 . 


Separating the variables and solving for w(t ), we find that 

w(t) = x/ (t) = ct 1/2 ; 

then 

v(t) = \ct 3/2 + k. 

It follows that 

y = = | ct 1/2 + hr 1 , (33) 

where c and k are arbitrary constants. The second term on the right side of Eq. (33) is a multiple 
of yi(t) and can be dropped, but the first term provides a new solution y 2 (t) = t 1/2 . You can 
verify that the Wronskian of yi and y 2 is 

W(y u y 2 )(t) = 11~ 3/2 ^0 for t > 0. (34) 

Consequently, yi and y 2 form a fundamental set of solutions of Eq. (31) for t > 0. 


In each of Problems 1 through 10, find the general solution of the given differential equation. 

1. y" — 2y' + y = 0 2. 9 y" + 6y f + y = 0 

3. 4 y" - 4/ - 3y = 0 4. 4y" + 12/ + 9y = 0 

5. y" - 2/ + lOy = 0 6. y" - 6/ + 9y = 0 
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7. 4y" + 17/ + 4y = 0 

9. 25y" - 20/ + 4y = 0 


8. 16/' + 24/ + 9y = 0 

10. 2y" + 2/ + y = 0 


In each of Problems 11 through 14, solve the given initial value problem. Sketch the graph of 
the solution and describe its behavior for increasing t. 

11. 9y" - 12/ + 4y = 0, y(0) = 2, /(0) = -1 

12. /' - 6/ + 9y = 0, y( 0) = 0, /(0) = 2 

13. 9/' + 6/ + 82}; = 0, y{ 0) = -1, /(0) = 2 

14. y" + 4/ + 4y = 0, y(-l) = 2, /(-l) = 1 

^2/ 15. Consider the initial value problem 


4/' + 12/ + 9y = 0, y( 0) = 1, /(0) = -4. 


(a) Solve the initial value problem and plot its solution for 0 < t < 5. 

(b) Determine where the solution has the value zero. 

(c) Determine the coordinates (t 0 ,yo) of the minimum point. 

(d) Change the second initial condition to /(0) = b and find the solution as a function 
of b. Then find the critical value of b that separates solutions that always remain positive 
from those that eventually become negative. 

16. Consider the following modification of the initial value problem in Example 2: 


/' - / + 0.25y = 0, y( 0) = 2, /(0) = b . 


Find the solution as a function of 6, and then determine the critical value of b that 
separates solutions that grow positively from those that eventually grow negatively. 

12. Consider the initial value problem 


4/' + 4/ + y = 0, y{ 0) = 1, /(0) = 2. 


(a) Solve the initial value problem and plot the solution. 

(b) Determine the coordinates (, t M ,yM ) of the maximum point. 

(c) Change the second initial condition to /(0) = b > 0 and find the solution as a function 
of b. 

(d) Find the coordinates ( tM,yM ) of the maximum point in terms of b. Describe the 
dependence of t M and y M on b as b increases. 

18. Consider the initial value problem 


9/' + 12/ + 4y = 0, y(0) = a > 0, /(0) = —1. 


(a) Solve the initial value problem. 

(b) Find the critical value of a that separates solutions that become negative from those 
that are always positive. 

19. Consider the equation ay" + by' + cy = 0. If the roots of the corresponding characteristic 
equation are real, show that a solution to the differential equation either is everywhere 
zero or else can take on the value zero at most once. 

Problems 20 through 22 indicate other ways of finding the second solution when the 
characteristic equation has repeated roots. 

20. (a) Consider the equation /' + 2 ay' + a 2 y = 0. Show that the roots of the characteristic 
equation are r\ = r 2 = —a , so that one solution of the equation is e~ at . 
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(b) Use Abel’s formula [Eq. (23) of Section 3.2] to show that the Wronskian of any two 
solutions of the given equation is 

W(t) = y 1 (t)y' 2 (t) -y\(t)y 2 (t) = c x e~ 2at , 


where C\ is a constant. 

(c) Let yi ( t ) = e~ at and use the result of part (b) to obtain a differential equation satisfied 
by a second solution y 2 (t). By solving this equation, show that y 2 (t) = te ~ at . 

21. Suppose that r\ and r 2 are roots of ar 2 + br + c = 0 and that /q y r 2 ; then exp(/qt) 
and exp(r 2 t) are solutions of the differential equation ay" + by' + cy = 0. Show that 
0(t;ri,r 2 ) = [exp(r 2 t) — exp(rit)]/(r 2 — n) is also a solution of the equation for r 2 y r\. 
Then think of /q as fixed, and use L’Hopital’s rule to evaluate the limit of 0(t;/q,r 2 ) as 
r 2 —> /q, thereby obtaining the second solution in the case of equal roots. 

22. (a) If ar 2 + br + c = 0 has equal roots /q, show that 

L[e rt ] = a(e rt )" + b{e n )' + ce rt = a(r - n) V. (i) 

Since the right side of Eq. (i) is zero when r = /q, it follows that exp(/qt) is a solution of 
L[y ] = ay" + by' + cy = 0. 

(b) Differentiate Eq. (i) with respect to r, and interchange differentiation with respect to 
r and with respect to t , thus showing that 

—e rt ~\ = L[te rt ] = ate n (r — ri) 2 + 2 ae rt (r - jq). (ii) 

3r 

Since the right side of Eq. (ii) is zero when r = ri, conclude that t exp(rit) is also a solution 
of L[y] = 0. 

In each of Problems 23 through 30, use the method of reduction of order to find a second 
solution of the given differential equation. 

23. t 2 y" — 4 ty' + 6y = 0, t > 0; yi(t) = t 2 

24. t 2 y" + 2 ty' — 2y = 0, t > 0; y 1 ( t ) = t 

25. t 2 y" + 3 ty' + y = 0, t > 0; y\(t) = t~ l 

26. t 2 y" - t(t + 2)y' + (t + 2)y = 0, t > 0; y\(t) = t 

27. xy" — y' + 4x 3 y = 0, x > 0; yi(x) = sinx 2 

28. (jc - 1 )y" —xy'+y = 0, x > 1; yi(x) = e* 

29. x 2 y" - (x - 0.1875)y = 0, x > 0; y\(x) = x 1/4 e 2 ^ 

30. x 2 y /; + xy' + (x 2 - 0.25)y = 0, x > 0; yi(x) = x~ 1/2 sinx 

31. The differential equation 

y" + 8(xy' + y) = 0 

arises in the study of the turbulent flow of a uniform stream past a circular cylinder. Verify 
that yi(x) = exp(— 8x 2 /2) is one solution, and then find the general solution in the form of 
an integral. 

32. The method of Problem 20 can be extended to second order equations with variable 
coefficients. If y\ is a known nonvanishing solution of y" + p(t)y' + q{t)y = 0, show that a 
second solution y 2 satisfies (y 2 /yiy = TT(yi,y 2 )/y 2 , where TT(yi,y 2 ) is the Wronskian of 
yi and y 2 . Then use Abel’s formula [Eq. (23) of Section 3.2] to determine y 2 . 


-L[e rt ] = L 
dr 
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In each of Problems 33 through 36, use the method of Problem 32 to find a second independent 
solution of the given equation. 

33. t 2 y" + 3 ty' + y = 0, t > 0; yi(t) = 

34. ty" — y + 4 t 3 y = 0, t > 0; yi(t) = sin(t 2 ) 

35. (x — 1 )y" — xy' + y = 0, x > 1; yi(x) = e x 

36. x 2 y" + x/ + (x 2 — 0.25 )y = 0, x > 0; yi(x) = x _1/2 sinx 

Behavior of Solutions as t ->► oo. Problems 37 through 39 are concerned with the behavior 
of solutions as t oo. 

37. If a, b , and c are positive constants, show that all solutions of ay" + by' + cy = 0 approach 
zero as t -> oo. 

38. (a) If a > 0 and c > 0, but 6 = 0, show that the result of Problem 37 is no longer true, but 
that all solutions are bounded as t oo. 

(b) If a > 0 and b > 0, but c = 0, show that the result of Problem 37 is no longer true, but 
that all solutions approach a constant that depends on the initial conditions as t oo. 
Determine this constant for the initial conditions y(0) = y 0 ,/(0) = y' 0 . 

39. Show that y = sin t is a solution of 

y" + (k sin 2 t)y' + (1 — k cos t sin t)y = 0 

for any value of the constant k. If 0 < k < 2, show that \ — k cos t sin t > 0 and k sin 2 1 > 0. 
Thus observe that even though the coefficients of this variable-coefficient differential equa¬ 
tion are nonnegative (and the coefficient of y' is zero only at the points t = 0, ...), 

it has a solution that does not approach zero as t oo. Compare this situation with the 
result of Problem 37. Thus we observe a not unusual situation in the study of differential 
equations: equations that are apparently very similar can have quite different properties. 

Euler Equations. In each of Problems 40 through 45, use the substitution introduced in 
Problem 34 in Section 3.3 to solve the given differential equation. 

40. t 2 y" — 3 ty' + 4y = 0, t > 0 

41. t 2 y" + 2 ty' + 0.25y = 0, t > 0 

42. 2 t 2 y" - 5 ty' + 5y = 0, t>0 

43. t 2 y" + 3ty' + y = 0, t > 0 

44. 4 t 2 y" - 8 ty' + 9y = 0, t > 0 

45. t 2 y" + Sty' + 13y = 0, t > 0 


3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients 

We now return to the nonhomogeneous equation 

L[y] = y” + p(t)y' + q(t)y = g(t), (1) 

where p , q , and g are given (continuous) functions on the open interval /. 
The equation 


L[y]= y" + p(t)y' + q(t)y = 0 , 


( 2 ) 
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Theorem 3.5.1 


Theorem 3.5.2 


in which g(t ) = 0 and p and q are the same as in Eq. (1), is called the homogeneous 
equation corresponding to Eq. (1). The following two results describe the structure of 
solutions of the nonhomogeneous equation ( 1 ) and provide a basis for constructing 
its general solution. 


If Y\ and Y 2 are two solutions of the nonhomogeneous equation (1), then their 
difference Y\ — Y 2 is a solution of the corresponding homogeneous equation ( 2 ). 
If, in addition, yi and y 2 are a fundamental set of solutions of Eq. (2), then 

Yi (0 - y 2 (t) = ciyiit) + c 2 y 2 (0, (3) 

where c\ and c 2 are certain constants. 


To prove this result, note that Y\ and Y 2 satisfy the equations 
L[Y 1 m=g(t) 9 L[Y 2 \(t)=g(t). 

Subtracting the second of these equations from the first, we have 
mm - L[Y 2 \(t) = git) - g{t) = 0. 


However, 


L[Y X \ - L[Y 2 ] = L[Y\ - Y 2 ], 


(4) 

(5) 


so Eq. (5) becomes 


L[Y 1 -Y 2 ](t) = 0. 


( 6 ) 


Equation ( 6 ) states that Y\ — Y 2 is a solution of Eq. (2). Finally, since by Theorem 
3.2.4 all solutions of Eq. (2) can be expressed as linear combinations of a fundamental 
set of solutions, it follows that the solution Y\ — Y 2 can be so written. Hence Eq. (3) 
holds and the proof is complete. 


The general solution of the nonhomogeneous equation (1) can be written in the 
form 

y = 4>(t) = Cyyi(t) + C 2 y 2 (t) + Y(t), (7) 

where yi and y 2 are a fundamental set of solutions of the corresponding homoge¬ 
neous equation (2), c\ and c 2 are arbitrary constants, and Y is some specific solution 
of the nonhomogeneous equation ( 1 ). 


The proof of Theorem 3.5.2 follows quickly from the preceding theorem. Note 
that Eq. (3) holds if we identify Y\ with an arbitrary solution 0 of Eq. (1) and Y 2 with 
the specific solution Y . From Eq. (3) we thereby obtain 

0(0 - Yit) = ciyiit) + c 2 y 2 it), (8) 

which is equivalent to Eq. (7). Since 0 is an arbitrary solution of Eq. (1), the expression 
on the right side of Eq. (7) includes all solutions of Eq. (1); thus it is natural to call it 
the general solution of Eq. (1). 
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In somewhat different words, Theorem 3.5.2 states that to solve the nonhomoge¬ 
neous equation (1), we must do three things: 

1. Find the general solution c\y\(t) + C2}^2(0 of the corresponding homogeneous equation. 
This solution is frequently called the complementary solution and may be denoted by y c (t). 

2. Find some single solution Y (; t ) of the nonhomogeneous equation. Often this solution is 
referred to as a particular solution. 

3. Form the sum of the functions found in steps 1 and 2. 

We have already discussed how to find y c (t), at least when the homogeneous equa¬ 
tion (2) has constant coefficients. Therefore, in the remainder of this section and in 
the next, we will focus on finding a particular solution Y(t) of the nonhomogeneous 
equation (1). There are two methods that we wish to discuss. They are known as 
the method of undetermined coefficients (discussed here) and the method of varia¬ 
tion of parameters (see Section 3.6). Each has some advantages and some possible 
shortcomings. 

Method of Undetermined Coefficients. The method of undetermined coefficients requires 
us to make an initial assumption about the form of the particular solution Y(t), but 
with the coefficients left unspecified. We then substitute the assumed expression into 
Eq. (1) and attempt to determine the coefficients so as to satisfy that equation. If we 
are successful, then we have found a solution of the differential equation (1) and can 
use it for the particular solution Y(t). If we cannot determine the coefficients, then 
this means that there is no solution of the form that we assumed. In this case we may 
modify the initial assumption and try again. 

The main advantage of the method of undetermined coefficients is that it is straight¬ 
forward to execute once the assumption is made about the form of Y(t). Its major 
limitation is that it is useful primarily for equations for which we can easily write 
down the correct form of the particular solution in advance. For this reason, this 
method is usually used only for problems in which the homogeneous equation has 
constant coefficients and the nonhomogeneous term is restricted to a relatively small 
class of functions. In particular, we consider only nonhomogeneous terms that consist 
of polynomials, exponential functions, sines, and cosines. Despite this limitation, the 
method of undetermined coefficients is useful for solving many problems that have 
important applications. However, the algebraic details may become tedious, and a 
computer algebra system can be very helpful in practical applications. We will illus¬ 
trate the method of undetermined coefficients by several simple examples and then 
summarize some rules for using it. 


Find a particular solution of 

EXAMPLE 

1 


y" - 3/ -4 y = 3e 2t . 


(9) 


We seek a function Y such that the combination Y"(t) — 3 Y'(t) — 4 Y(t) is equal to 3e 2 '. 
Since the exponential function reproduces itself through differentiation, the most plausible 
way to achieve the desired result is to assume that Y(t) is some multiple of e 2t , 


Y(t) = Ae 2t , 
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EXAMPLE 

2 


where the coefficient A is yet to be determined. To find A, we calculate 

Y'(t) = 2 Ae 2 ‘, Y"(t) = 4Ae 21 , 

and substitute for y, y', and y" in Eq. (9). We obtain 

(4 A -6 A- 4A)e 21 = 3e 2t . 

Hence —6 Ae 2t must equal 3e 2 ', so A = —1/2. Thus a particular solution is 

Y(t) = -ie 2 '. (10) 


Find a particular solution of 

y" — 3y' — 4y = 2 sin t. (11) 

By analogy with Example 1, let us first assume that Y{t) = A sin t, where A is a constant to 
be determined. On substituting in Eq. (11) we obtain 

—A sin t — 3A cos t — 4A sin t = 2 sin t , 


or, by rearranging terms, 

(2 T 5A) sin t T 3 A cos t — 0. (12) 

We want Eq. (12) to hold for all t. Thus it must hold for two specific points, such as t = 0 
and t = 7t/ 2. At these points Eq. (12) reduces to 3A = 0 and 2 + 5A = 0, respectively. These 
contradictory requirements mean that there is no choice of the constant A that makes 
Eq. (12) true for t = 0 and t = tt/2, much less for all t. Thus we conclude that our assumption 
concerning Y (t) is inadequate. 

The appearance of the cosine term in Eq. (12) suggests that we modify our original 
assumption to include a cosine term in Y ( t)\ that is, 

Y(t) = A sin t + B cos t, 

where A and B are to be determined. Then 

Y'(t ) = A cos t — B sin t, Y"(t) = —A sin t — B cos t. 

By substituting these expressions for y,y', and y" in Eq. (11) and collecting terms, we obtain 

(—A + 3 B — 4A) sin t + ( —B — 3A — 4B) cos t = 2 sin t. (13) 

To satisfy Eq. (13), we must match the coefficients of sin t and cos t on each side of the equation; 
thus A and B must satisfy the equations 

-5A + 3B = 2, -3 A -5B = 0. 

By solving these equations for A and B, we obtain A = — 5/17and# = 3/17; hence a particular 
solution of Eq. (11) is 

Y (t) = - ^ sin t + ^ cos t. 

The method illustrated in the preceding examples can also be used when the right 
side of the equation is a polynomial. Thus, to find a particular solution of 

y" - 3 / - 4 y = 41 2 - 1 , ( 14 ) 

we initially assume that Y(t) is a polynomial of the same degree as the nonhomoge- 
neous term; that is, Y (, t ) = At 2 + Bt + C. 
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To summarize our conclusions up to this point: if the nonhomogeneous term g(t ) 
in Eq. (1) is an exponential function e at , then assume that Y(t) is proportional to 
the same exponential function; if g(t ) is sin fit or cos fit, then assume that Y(t) is a 
linear combination of sin fit and cos /3t; if g(t) is a polynomial, then assume that Y ( t) 
is a polynomial of like degree. The same principle extends to the case where g(t) is 
a product of any two, or all three, of these types of functions, as the next example 
illustrates. 


Find a particular solution of 

EXAMPLE y" — 3/ — 4y = —Se t cos 2t. (15) 

3 In this case we assume that Y(t) is the product of e l and a linear combination of cos 2 1 and 

sin2q that is, 

Y(t) = Ae l cos 2 1 + Be 1 sin 2 1. 

The algebra is more tedious in this example, but it follows that 

Y'(t) — (A + 2 B)e t cos 2 1 + (-2 A + B)e f sin 2 1 

and 

Y"(0 = (-3A + 4 B)e f cos 2 1 + (-4 A - 3B)e t sin 2 1. 

By substituting these expressions in Eq. (15), we find that A and B must satisfy 

10A + 2B = 8, 2A - 105 = 0. 

Hence A = 10/13 and B = 2/13; therefore, a particular solution of Eq. (15) is 

Y{t) = f|^cos2^+ ^^sin2L 


Now suppose that g(t) is the sum of two terms, g(t) = g\(t) + gi(t ), and suppose 
that Yi and Y 2 are solutions of the equations 

ay" + by' + cy = gi (0 (16) 

and 

ay" + by' + cy = g 2 (t), (17) 

respectively. Then Yi + Y 2 is a solution of the equation 

ay" + by' + cy = g(t). (18) 

To prove this statement, substitute Y\(t) + Y 2 (t) for y in Eq. (18) and make use 
of Eqs. (16) and (17). A similar conclusion holds if g(t) is the sum of any finite 
number of terms. The practical significance of this result is that for an equation 
whose nonhomogeneous function g(t) can be expressed as a sum, you can consider 
instead several simpler equations and then add the results together. The following 
example is an illustration of this procedure. 


EXAMPLE 


4 


Find a particular solution of 

y" — 3y — 4v = 3e 2 ' + 2 sin t — 8e' cos 2 1. 

By splitting up the right side of Eq. (19), we obtain the three equations 

y” - 3/ -4 y = 3e 2t , 
y" - 3/ - 4y = 2 sin t. 


( 19 ) 
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EXAMPLE 

5 


and 


/' - 3 y' — 4y = -Se t cos 2 1. 


Solutions of these three equations have been found in Examples 1, 2, and 3, respectively. 
Therefore, a particular solution of Eq. (19) is their sum, namely, 

Y(t) = — \e 2t + ff cos t - ^ sin t+ cos 2 1 + sin2 1. 


The procedure illustrated in these examples enables us to solve a fairly large class 
of problems in a reasonably efficient manner. However, there is one difficulty that 
sometimes occurs. The next example illustrates how it arises. 


Find a particular solution of 

y" -3y f -4y = 2e~ t . (20) 

Proceeding as in Example 1, we assume that Y(t) = Ae~ l . By substituting in Eq. (20), we 
obtain 

(A + 3A - 4A)e~ t = 2<T ? . (21) 

Since the left side of Eq. (21) is zero, there is no choice of A that satisfies this equation. 
Therefore, there is no particular solution of Eq. (20) of the assumed form. The reason for this 
possibly unexpected result becomes clear if we solve the homogeneous equation 

/ - 3/ - 4y = 0 (22) 

that corresponds to Eq. (20). A fundamental set of solutions of Eq. (22) is y 1 (t) = e~ l and 
y 2 (t) = e 4t . Thus our assumed particular solution of Eq. (20) is actually a solution of the 
homogeneous equation (22); consequently, it cannot possibly be a solution of the nonho- 
mogeneous equation (20). To find a solution of Eq. (20), we must therefore consider functions 
of a somewhat different form. 

At this stage, we have several possible alternatives. One is simply to try to guess the proper 
form of the particular solution of Eq. (20). Another is to solve this equation in some different 
way and then to use the result to guide our assumptions if this situation arises again in the future; 
see Problems 29 and 35 for other solution methods. Still another possibility is to seek a simpler 
equation where this difficulty occurs and to use its solution to suggest how we might proceed 
with Eq. (20). Adopting the latter approach, we look for a first order equation analogous to 
Eq. (20). One possibility is the linear equation 

y'+y = 2e- t . (23) 

If we try to find a particular solution of Eq. (23) of the form Ae~\ we will fail because e~ x 
is a solution of the homogeneous equation y' + y = 0. However, from Section 2.1 we already 
know how to solve Eq. (23). An integrating factor is fi(t) = e\ and by multiplying by n(t) and 
then integrating both sides, we obtain the solution 

y = 2 te~ f + ce~ l . (24) 

The second term on the right side of Eq. (24) is the general solution of the homogeneous 
equation y' + y = 0, but the first term is a solution of the full nonhomogeneous equation (23). 
Observe that it involves the exponential factor e~ l multiplied by the factor t. This is the clue 
that we were looking for. 

We now return to Eq. (20) and assume a particular solution of the form Y(t) = Ate ~ f . Then 
Y\t) = Ae- f - Ate- 1 , Y"(t) = -2Ae~ x + Ate^. (25) 
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Substituting these expressions for y, /, and y" in Eq. (20), we obtain 
(-2 A - 3 A)e~ t + (A+ 3A - 4 A)te- f = 2<T r . 

The coefficient of te~ f is zero, so from the terms involving e* we have —5 A = 2, or A = —2/5. 
Thus a particular solution of Eq. (20) is 

Y(f) = -§fcT*. (26) 

The outcome of Example 5 suggests a modification of the principle stated pre¬ 
viously: if the assumed form of the particular solution duplicates a solution of the 
corresponding homogeneous equation, then modify the assumed particular solution 
by multiplying it by t. Occasionally, this modification will be insufficient to remove 
all duplication with the solutions of the homogeneous equation, in which case it is 
necessary to multiply by t a second time. For a second order equation, it will never 
be necessary to carry the process further than this. 

Summary. We now summarize the steps involved in finding the solution of an initial 
value problem consisting of a nonhomogeneous equation of the form 

ay" + by' + cy = g(t), (27) 

where the coefficients a , b , and c are constants, together with a given set of initial 
conditions. 

1. Find the general solution of the corresponding homogeneous equation. 

2. Make sure that the function g(t) in Eq. (27) belongs to the class of functions discussed 
in this section; that is, be sure it involves nothing more than exponential functions, sines, 
cosines, polynomials, or sums or products of such functions. If this is not the case, use the 
method of variation of parameters (discussed in the next section). 

3. If g(t ) = gi(t) H-1- g n (t )— that is, if g(t) is a sum of n terms — then form n subproblems, 

each of which contains only one of the terms g\(t ),... ,g n (t). The zth subproblem consists 
of the equation 

ay" + by' + cy = gi(t), 

where i runs from 1 to n. 

4. For the ith subproblem assume a particular solution Y t (t) consisting of the appropriate 
exponential function, sine, cosine, polynomial, or combination thereof. If there is any 
duplication in the assumed form of Y t {t) with the solutions of the homogeneous equation 
(found in step 1), then multiply Y t (t) by t , or (if necessary) by t 2 , so as to remove the 
duplication. See Table 3.5.1. 

5. Find a particular solution Y t (t) for each of the subproblems. Then the sum 

Y\ (t) 4-+ Y n (t ) is a particular solution of the full nonhomogeneous equation (27). 

6. Form the sum of the general solution of the homogeneous equation (step 1) and the 
particular solution of the nonhomogeneous equation (step 5). This is the general solution 
of the nonhomogeneous equation. 

7. Use the initial conditions to determine the values of the arbitrary constants remaining in 
the general solution. 

For some problems this entire procedure is easy to carry out by hand, but often 
the algebraic calculations are lengthy. Once you understand clearly how the method 
works, a computer algebra system can be of great assistance in executing the details. 
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TABLE 3.5.1 The Particular Solution of ay" + by' + cy = g t (t) 


gi(t ) 

Y,(t) 

P n (0 — ao t n + a\t n 1 + • • • + a n 

f(A 0 t n +A 1 t n ~ 1 + - 

• • + A n ) 

Pn(t)e at 

t s (A 0 t n +A 1 t n ~ 1 + ■ 

■■+A n )<* 

. [sin fit 

Pn(t)e at 

f[(A 0 t n + A 1 t n ~ 1 + 

- b A n )e at cos fit 

1 cos fit 

+ (Bor + Bif- 

_1 H - b B n )e at sin fit\ 


Notes. Here s is the smallest nonnegative integer (5 = 0,1, or 2) that will ensure that no 
term in Y t {t) is a solution of the corresponding homogeneous equation. Equivalently, 
for the three cases, 5 is the number of times 0 is a root of the characteristic equation, a is 
a root of the characteristic equation, and a + ip is a root of the characteristic equation, 
respectively. 

The method of undetermined coefficients is self-correcting in the sense that if you 
assume too little for Y(t), then a contradiction is soon reached that usually points the 
way to the modification that is needed in the assumed form. On the other hand, if you 
assume too many terms, then some unnecessary work is done and some coefficients 
turn out to be zero, but at least the correct answer is obtained. 

Proof of the Method of Undetermined Coefficients. In the preceding discussion we have 
described the method of undetermined coefficients on the basis of several exam¬ 
ples. To prove that the procedure always works as stated, we now give a general 
argument, in which we consider three cases corresponding to different forms for the 
nonhomogeneous term g(t). 

Case 1: g(t ) = P n (t ) = a^t 11 + a\t n ~ x +- V a n . In this case Eq. (27) becomes 

ay" T by' T cy = a§t n T a\t n ^ T • • • T a n . (2$) 

To obtain a particular solution, we assume that 

Y ( t ) = Ao t n + A\t n 1 + • • • + A n - 2^ 2 + A n -\t + A n . (29) 

Substituting in Eq. (28), we obtain 

a[n(n — l)Aot n 2 + • • • + 2A n -2] + bfnAof 1 1 + • • • + A n -i) 

+ c(Aot n + A\t n 1 + • • • + A n ) = a$t n + • • • + a n . (30) 

Equating the coefficients of like powers of t , beginning with t n , leads to the following 
sequence of equations: 

cA§ — $ 0 , 
cA\ + nbAo = 0 i, 


cA n T bA n — 1 T 2aA n —2 — a n . 

Provided that c ^0, the solution of the first equation is Ao = ao/c, and the remaining 
equations determine Ai,...,A n successively. If c = 0 but b ^ 0, then the polynomial 
on the left side of Eq. (30) is of degree n — 1, and we cannot satisfy Eq. (30). To be 
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sure that aY"(t ) + bY\t) is a polynomial of degree n , we must choose Y(t) to be a 
polynomial of degree n + 1. Hence we assume that 

Y (t) = t(Aot n + • • • + A n ). 

There is no constant term in this expression for Y(t), but there is no need to include 
such a term since a constant is a solution of the homogeneous equation when c = 0. 
Since b ^ 0, we have Aq = a^/bin + 1), and the other coefficients Ai,... ,A n can be 
determined similarly. If both c and b are zero, we assume that 

Y (t) = t 2 (Aot n + • • • + A n ). 

The term a Y"(t) gives rise to a term of degree n , and we can proceed as before. Again 
the constant and linear terms in Y( t ) are omitted, since in this case they are both 
solutions of the homogeneous equation. 

Case 2: g(t ) = e at P n (t). The problem of determining a particular solution of 

ay" + by' + cy = e at P n (t) (31) 

can be reduced to the preceding case by a substitution. Let 

Y(t) = e at u(t)\ 

then 

Y\t) = e at [u'(t) + au(t)] 

and 

Y"(t) = e at [u"(t) + 2 au'(t) + a 2 u(t)]. 

Substituting for y, /, and y" in Eq. (31), canceling the factor e at , and collecting terms, 
we obtain 

au"(t) + (2 aa + b)u'(t ) + (aa 2 + to + c)w(t) = P n (t). (32) 

The determination of a particular solution of Eq. (32) is precisely the same problem, 
except for the names of the constants, as solving Eq. (28). Therefore, if aa 2 + ba + c 

is not zero, we assume that u{t) = A$t n +- V A n \ hence a particular solution of 

Eq. (31) is of the form 

Y(t) = e at (A qY + A\t n i + ■ ■ ■ + A n ). (3^) 

On the other hand, if aa 2 + ba + c is zero but 2 aa + b is not, we must take u{t) to be of 
the form t(A$t n + • • • + A n ). The corresponding form for Y(t) is t times the expression 
on the right side of Eq. (33). Note that if aa 2 + ba + c is zero, then e at is a solution 
of the homogeneous equation. If both aa 2 + ba + c and 2 aa + b are zero (and this 
implies that both e at and are solutions of the homogeneous equation), then the 
correct form for u(t) is t 2 (A$t n + • • • + A n ). Hence Y (t) is t 2 times the expression on 
the right side of Eq. (33). 

Case 3: g(t ) = e^Pnit) cos fit or e at P n (t ) sin /?f. These two cases are similar, so we 
consider only the latter. We can reduce this problem to the preceding one by noting 
that, as a consequence of Euler’s formula, sin /3t = ( e l & — e~ l ^)/2 i. Hence g(t) is of 
the form 

e (a+ip)t _ e (a-ip)t 

g(t) = P n (t) 


2 i 
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and we should choose 

Y(t) = e (a+i V‘(A 0 t n + ---+A n ) + + • • • + B n ), 

or, equivalently, 

Y(t ) = e at {Aot n + -b A n ) cos fit + e at (Bot n + • • • + B n ) sin fit. 

Usually, the latter form is preferred. If a ± ifi satisfy the characteristic equation cor¬ 
responding to the homogeneous equation, we must, of course, multiply each of the 
polynomials by t to increase their degrees by one. 

If the nonhomogeneous function involves both cos fit and sin fit , it is usually con¬ 
venient to treat these terms together, since each one individually may give rise to the 
same form for a particular solution. For example, if g(t) = t sin t + 2 cos t , the form 
for Y (i t ) would be 


Y (t) — (Aot + A \) sin t -b ( B§t -\- B\) cos t, 
provided that sin t and cos t are not solutions of the homogeneous equation. 


PROBLEMS In each of Problems 1 through 14, find the general solution of the given differential equation. 


1. 

y” 

1 

1 

= 3e 2 ' 

2. 

r 

+ 

2 y+5^ 

= 3 sin 2 1 

3. 

y" 

1 

x. 

1 

n 

= -2 1 + At 2 

4. 

y" 

-b 

/ - 6y = 

= 12e 3 ' + 12e 

5. 

y" 

1 

1 

LO 

= -3fc- ( 

6. 

y" 

+ 

2y ; = 3 + 4 sin 2^ 

7. 

y" 

-b 9y = t 2 e 3t + 6 

8. 

y" 

-b 

+ 

n 

= 2<r f 

9. 

2 y 

" + 3/ -by 

= F -b 3 sin t 

10. 

y" 

+ 

y = 3 sin 

2£ + tcos2t 

11. 

u" 

+ CO^U = COS cot , CO 2 7 ^ &»o 

12. 

u" 

+ 

colu = cos COot 

13. 

y" 

II 

+ 

+ 

- 2 sinh r 

14. 

y" 

- 

1 

n 

- cosh 2r 


Hint: sinh t = 

(e‘ - e~‘)/2 


Hint: 

■ cosh £ = 

(e'+e-')/2 


In each of Problems 15 through 20, find the solution of the given initial value problem. 

15. y" +y-2y = 2t, y( 0) = 0, y'(0) = 1 

16. y" -b 4y = t 2 + 3e\ y(0) = 0, y'(0) = 2 

17. y" — 2y' + y = te l + 4, y(0) = 1, /(0) = 1 

18. y" - 2 y -3 y = 3 te 2t , y(0) = 1, y'(0) = 0 

19. y" -b 4y = 3 sin2t, y(0) = 2, y'(0) = -1 

20. y" + 2)/ + 5y = 4e~ l cos 2 1, y(0) = 1, /(0) = 0 


In each of Problems 21 through 28: 

(a) Determine a suitable form for Y(t) if the method of undetermined coefficients is to be 
used. 

(b) Use a computer algebra system to find a particular solution of the given equation. 

4fl, 21. f + 3y' = 21 4 + t 2 e~ 3t + sin3£ 

4fi 22. y" y = t(l + sin t) 

fQ, 23. y" - 5 y' + 6y = cos 2 1 + e 2t {31 + 4) sin t 

^2/ 24. y" + 2y' + 2y = 3e~ l + 2e~ l cos t + 4e~H 2 sin t 

25. y" - 4y' + 4y = 2 1 2 + 4 te 2t + t sin 2 1 

26. y" + 4y = t 2 sin 2t -b (6^ + 7) cos 2t 
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27. y" + 3 y + 2 y = e f (t 2 + 1) sin 2t + 3e f cos t + 4e l 

28. y" + 2 y' + 5y = 3 te~ f cos 2 1 - 2te~ 2t cos t 

29. Consider the equation 

/ _ 3/ -4y = 2e~ f (i) 

from Example 5. Recall thatyi(t) = e~ f andy 2 (0 = e 4t are solutions of the corresponding 
homogeneous equation. Adapting the method of reduction of order (Section 3.4), seek a 
solution of the nonhomogeneous equation of the form Y(t) = v(t)yi(t) = v(t)e~\ where 
v(t) is to be determined. 

(a) Substitute Y(t), Y'(t ), and Y"(t) into Eq. (i) and show that v{t) must satisfy 
v" — 5v' = 2. 

(b) Let w(t) = v'(t) and show that w(t) must satisfy w' — 5w = 2. Solve this equation 
for w(t). 

(c) Integrate w(t) to find v(t) and then show that 

Y(t) = -lte-‘+\c l e 4 ‘+ c 2 e-‘. 

The first term on the right side is the desired particular solution of the nonhomogeneous 
equation. Note that it is a product of t and e ~ l . 

30. Determine the general solution of 


N 

y" + X 2 y = ^ a m sin mitt, 

m =1 


where X > 0 and X ^ mn for m = 1,..., N. 

31. In many physical problems the nonhomogeneous term may be specified by different 
formulas in different time periods. As an example, determine the solution y = (p(t) of 


f + y = 


t, 

7re n -\ 


0 < t < 7T, 

t > 7T, 


satisfying the initial conditions y(0) = 0 and /(0) = 1. Assume that y and y' are also con¬ 
tinuous at t = 7t. Plot the nonhomogeneous term and the solution as functions of time. 
Hint: First solve the initial value problem for t < tt; then solve for t > tt, determining the 
constants in the latter solution from the continuity conditions at t = tt. 

01 32. Follow the instructions in Problem 31 to solve the differential equation 


/ + 2/ + 5y 


jl, 0 < t < 7t/2, 
[0, t > 7t/2 


with the initial conditions y (0) = 0 and /(0) = 0. 

Behavior of Solutions as t —► oo. In Problems 33 and 34, we continue the discussion started 
with Problems 37 through 39 of Section 3.4. Consider the differential equation 


ay" + by' + cy = g(t), 


(i) 


where a , b , and c are positive. 

33. If Y\(t) and Y 2 (t) are solutions of Eq. (i), show that Y\{t) - Y 2 (t) 0 as t oo. Is this 

result true if b = 0? 

34. If g(t) = d, a constant, show that every solution of Eq. (i) approaches d/c as t -> oo. What 
happens if c = 0? What if b = 0 also? 
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35. In this problem we indicate an alternative procedure 7 for solving the differential equation 

y" + by' + cy = ( D 2 + bD + c)y = g(t ), (i) 

where b and c are constants, and D denotes differentiation with respect to t. Let r\ and r 2 
be the zeros of the characteristic polynomial of the corresponding homogeneous equation. 
These roots may be real and different, real and equal, or conjugate complex numbers. 

(a) Verify that Eq. (i) can be written in the factored form 

(D - ri)(D - r 2 )y = g(t), 


where n+r 2 = —b and r\r 2 = c. 

(b) Let u = (D — r 2 )y. Then show that the solution of Eq (i) can be found by solving the 
following two first order equations: 

(D - n)u = g(t ), CD - r 2 )y = u(t). 


In each of Problems 36 through 39, use the method of Problem 35 to solve the given differential 
equation. 

36. y" — 3 y' — 4y = 3e 2t (see Example 1) 

37. 2 y" + 3/ + y = t 2 + 3 sin t (see Problem 9) 

38. y" + 2 y + y = 2e~ f (see Problem 8) 

39. y" + 2/ = 3 + 4 sin 2 1 (see Problem 6) 


3.6 Variation of Parameters 


In this section we describe another method of finding a particular solution of a non- 
homogeneous equation. This method, variation of parameters, is due to Lagrange and 
complements the method of undetermined coefficients rather well. The main advan¬ 
tage of variation of parameters is that it is a general method ; in principle at least, it can 
be applied to any equation, and it requires no detailed assumptions about the form 
of the solution. In fact, later in this section we use this method to derive a formula for 
a particular solution of an arbitrary second order linear nonhomogeneous differen¬ 
tial equation. On the other hand, the method of variation of parameters eventually 
requires us to evaluate certain integrals involving the nonhomogeneous term in the 
differential equation, and this may present difficulties. Before looking at this method 
in the general case, we illustrate its use in an example. 

Find a particular solution of 

y" + 4y = 3csct. (1) 

Observe that this problem is not a good candidate for the method of undetermined coeffi¬ 
cients, as described in Section 3.5, because the nonhomogeneous term g(t) = 3csc t involves 


EXAMPLE 

1 


7 R. S. Luthar, “Another Approach to a Standard Differential Equation,” Two Year College Mathematics 
Journal 10 (1979), pp. 200-201. Also see D. C. Sandell and E M. Stein, “Factorization of Operators of 
Second Order Linear Homogeneous Ordinary Differential Equations,” Two Year College Mathematics 
Journal 8 (1977), pp. 132-141, for a more general discussion of factoring operators. 
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a quotient (rather than a sum or a product) of sin t or cos t. Therefore, we need a different 
approach. Observe also that the homogeneous equation corresponding to Eq. (1) is 

/+4y = 0, (2) 

and that the general solution of Eq. (2) is 

y c (t) = Ci cos 2 1 + c 2 sin 2 1. (3) 

The basic idea in the method of variation of parameters is to replace the constants c 1 and c 2 
in Eq. (3) by functions u\{t ) and u 2 (t ), respectively, and then to determine these functions so 
that the resulting expression 


y — u\ (t) cos 2 1 + u 2 (t) sin 2 1 (4) 

is a solution of the nonhomogeneous equation (1). 

To determine U\ and u 2 , we need to substitute for y from Eq. (4) in Eq. (1). However, even 
without carrying out this substitution, we can anticipate that the result will be a single equation 
involving some combination of u\,u 2 , and their first two derivatives. Since there is only one 
equation and two unknown functions, we can expect that there are many possible choices of 
u\ and u 2 that will meet our needs. Alternatively, we may be able to impose a second condition 
of our own choosing, thereby obtaining two equations for the two unknown functions u\ and 
u 2 . We will soon show (following Lagrange) that it is possible to choose this second condition 
in a way that makes the computation markedly more efficient. 

Returning now to Eq. (4), we differentiate it and rearrange the terms, thereby obtaining 

y' — —2u\ (t) sin 2 1 + 2 u 2 (t) cos 2 1 + u[ ( t ) cos 2 1 + u 2 it) sin 2 1. (5) 

Keeping in mind the possibility of choosing a second condition on u\ and u 2 , let us require the 
sum of the last two terms on the right side of Eq. (5) to be zero; that is, we require that 

u\ ( t ) cos 2 1 + u' 2 ( t ) sin 2t — 0. (6) 

It then follows from Eq. (5) that 

y' = —2u\ ( t ) sin2 1 + 2 u 2 (t) cos 2 1. (7) 

Although the ultimate effect of the condition (6) is not yet clear, at the very least it has simplified 
the expression for y'. Further, by differentiating Eq. (7) we obtain 

y" — —Aui(t) cos2 1 — 4u 2 (t) sin2 1 — 2u[(t) sin2 1 + 2u! 2 (t) cos2 1. (8) 

Then, substituting for y and y" in Eq. (1) from Eqs. (4) and (8), respectively, we find that 

y" + 4y = — 4ui(t ) cos2£ — 4u 2 (t) sin2 1 — 2u\(t) sin2 1 + 2 u 2 (t) cos2 1 
+ 4ui ( t ) cos 2 1 + 4u 2 ( t ) sin 2t = 3 esc t. 

Hence U\ and u 2 must satisfy 


—2 u[ (0 sin 2 1 + 2u 2 ( t ) cos 2t = 3 esc t. 


(9) 


Summarizing our results to this point, we want to choose U\ and u 2 so as to satisfy Eqs. (6) 
and (9). These equations can be viewed as a pair of linear algebraic equations for the two 
unknown quantities u\ (t) and u 2 (t). Equations (6) and (9) can be solved in various ways. For 
example, solving Eq. (6) for u' 2 (t ), we have 


u 2 (t) = —u\(t) 


cos 2 1 
sin 2 1 


( 10 ) 
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Then, substituting for u 2 (t) in Eq. (9) and simplifying, we obtain 

. 3 esc t sin 2 1 

u A (t) = ---= —3 cost. 


( 11 ) 


Further, putting this expression for u[ ( t ) back in Eq. (10) and using the double-angle formulas, 
we find that 


. 3 cost cos 2t 3(1 —2 sin 1 1) 3 

Uj (t) =- : — -=-—-= - esc t — 3 sin t. 

sin 21 2 sin t 2 


( 12 ) 


Having obtained u\ (t) and u 2 (t), we next integrate so as to find u\(t) and u 2 (t). The result is 


u\{t) = —3 sint + ci 


and 


u 2 {t ) = | In | esc t — cot t| + 3 cos t + c 2 . 

On substituting these expressions in Eq. (4), we have 

y = — 3 sin t cos 2t + | In | esc t — cot t| sin 2t + 3 cos t sin 21 
+ ci cos 21 + c 2 sin 21. 


(13) 

(14) 


Finally, by using the double-angle formulas once more, we obtain 

y = 3 sin t + | In | esc t — cot t| sin21 + ci cos 2t + C 2 sin2t. (15) 

The terms in Eq. (15) involving the arbitrary constants ci and C 2 are the general solution of the 
corresponding homogeneous equation, while the remaining terms are a particular solution of 
the nonhomogeneous equation (1). Thus Eq. (15) is the general solution of Eq. (1). 


In the preceding example the method of variation of parameters worked well in 
determining a particular solution, and hence the general solution, of Eq. (1). The next 
question is whether this method can be applied effectively to an arbitrary equation. 
Therefore, we consider 

y" + p(t)y' + q(t)y = g(t), (16) 

where p, q , and g are given continuous functions. As a starting point, we assume that 
we know the general solution 

y c (t) = Ciyiit) + C 2 y 2 (t) (17) 

of the corresponding homogeneous equation 

y "+p(t)y' + q(t)y = 0. (18) 

This is a major assumption. So far we have shown how to solve Eq. (18) only if it has 
constant coefficients. If Eq. (18) has coefficients that depend on t, then usually the 
methods described in Chapter 5 must be used to obtain y c (t). 

The crucial idea, as illustrated in Example 1, is to replace the constants c\ and 
in Eq. (17) by functions u\(t) and respectively; thus we have 

y = mi (t)yi(t) + u 2 (t)y 2 (t). (19) 

Then we try to determine u\(t) and u 2 (t) so that the expression in Eq. (19) is a solution 
of the nonhomogeneous equation (16) rather than the homogeneous equation (18). 
Thus we differentiate Eq. (19), obtaining 

y' = u[(t)yi(t) + wi(0/i(0 + u’ 2 {t)y 2 {t) + u 2 (t)y’ 2 (t). 


( 20 ) 
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Theorem 3.6.1 


As in Example 1, we now set the terms involving u[(t) and u' 2 (t) in Eq. (20) equal to 
zero; that is, we require that 


u[(t)yi(t) + u' 2 (t)y 2 (t) = 0. (21) 

Then, from Eq. (20), we have 

/ = ui (; t)y[ it) + u 2 ( t)y 2 it). (22) 


Further, by differentiating again, we obtain 

f = u[(t)y[(t) + ui(t)y'[(t) + u 2 (t)y 2 (t) + u 2 (t)y 2 (t). (23) 

Now we substitute for y, /, and y" in Eq. (16) from Eqs. (19), (22), and (23), 
respectively. After rearranging the terms in the resulting equation, we find that 

ui(t)[y"(t) + p(t)y[(t) + q(t)yi(t)\ 

+ u 2 (t)[y 2 (t) +p(t)y' 2 (t ) + q(t)y 2 (t)\ 

+ u[(t)y[(t) + u 2 (t)y 2 (t) = g{t). (24) 

Each of the expressions in square brackets in Eq. (24) is zero because both yi and y 2 
are solutions of the homogeneous equation (18). Therefore, Eq. (24) reduces to 

( t)y[ it) + u 2 it)y 2 it) = git). (25) 


Equations (21) and (25) form a system of two linear algebraic equations for the 
derivatives u\ it) and u 2 it) of the unknown functions. They correspond exactly to 
Eqs. (6) and (9) in Example 1. 

By solving the system (21), (25) we obtain 


u[it) = - 


y ijt)git) 

W(yuy 2 )(t) ’ 


u 2 it) 


yiiOgjt) 
W(yuy 2 )(t) ’ 


(26) 


where W(yi,y 2 ) is the Wronskian of y\ andy 2 - Note that division by W is permissible 
since yi and y 2 are a fundamental set of solutions, and therefore their Wronskian 
is nonzero. By integrating Eqs. (26), we find the desired functions u\it) and u 2 it ), 
namely, 


uiit) = 


/ 


W{yi,y 2 ){t) 


dt C \, 


u 2 (t) = 


/ 


yiiOgjt) 

W(y l9 y 2 )(t) 


dt T c 2 . 


(27) 


If the integrals in Eqs. (27) can be evaluated in terms of elementary functions, then we 
substitute the results in Eq. (19), thereby obtaining the general solution of Eq. (16). 
More generally, the solution can always be expressed in terms of integrals, as stated 
in the following theorem. 


If the functions p , q , and g are continuous on an open interval /, and if the functions 
yi and y 2 are a fundamental set of solutions of the homogeneous equation (18) 
corresponding to the nonhomogeneous equation (16) 


/ +P(t)y' + qit)y = git), 
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then a particular solution of Eq. (16) is 

( f‘ y2(s)g(s) 
J tc\ 


Y(t ) = -yiU) 


ds +y 2 (t) 


f 

Jtf) 


yi(s)g(s) 


ds, 


Ito W(y 1 ,y 2 )(s) J t0 W(yi,y 2 )(s) 

where to is any conveniently chosen point in I. The general solution is 

y = ciyi(t) + c 2 y 2 (t) + Y(t), 
as prescribed by Theorem 3.5.2. 


(28) 


(29) 


By examining the expression (28) and reviewing the process by which we derived 
it, we can see that there may be two major difficulties in using the method of variation 
of parameters. As we have mentioned earlier, one is the determination of y\(t) and 
y 2 (t ), a fundamental set of solutions of the homogeneous equation (18), when the 
coefficients in that equation are not constants. The other possible difficulty lies in 
the evaluation of the integrals appearing in Eq. (28). This depends entirely on the 
nature of the functions yi, y 2 , and g. In using Eq. (28), be sure that the differential 
equation is exactly in the form (16); otherwise, the nonhomogeneous term g(t) will 
not be correctly identified. 

A major advantage of the method of variation of parameters is that Eq. (28) pro¬ 
vides an expression for the particular solution Y ( t ) in terms of an arbitrary forcing 
function g(t). This expression is a good starting point if you wish to investigate the 
effect of variations in the forcing function, or if you wish to analyze the response of 
a system to a number of different forcing functions. 


PROBLEMS 


In each of Problems 1 through 4, use the method of variation of parameters to find a particular 
solution of the given differential equation. Then check your answer by using the method of 
undetermined coefficients. 

1. y" — 5 y' + 6y = 2e l 2. y" — y' — 2y = 2e~ f 

3. y" + 2y' + y = 3e~ f 4. 4 y" — 4/ + y = 16e r/2 


In each of Problems 5 through 12, find the general solution of the given differential equation. 

In Problems 11 and 12, g is an arbitrary continuous function. 

5. y" + y = tan t , 0 < t < n/2 6. y" + 9y = 9 sec 2 3 1, 0 < t < i r/6 

7. y" + 4 y' + 4 y = t~ 2 e~ 2 \ t > 0 8. y" + 4y = 3 esc 2 1, 0 < t < n/2 

9. 4 y" + y = 2 sec(t/2), — n < t < n 10. y” -2y'-\-y = e*/(l + t 2 ) 

11. y n - 5/ + 6y = g(t) 12. y" + 4y = g(t) 


In each of Problems 13 through 20, verify that the given functions y\ and y 2 satisfy the corre¬ 

sponding homogeneous equation; then find a particular solution of the given nonhomogeneous 

equation. In Problems 19 and 20, g is an arbitrary continuous function. 

13. t 2 y" - 2y = 3t 2 - 1, t > 0; y x {t) = f 2 , y 2 (t) = r 1 

14. t 2 y" - t(t + 2 )y' + (t + 2 )y = 21 3 * * * 7 * * * * * 13 14 15 16 17 , t > 0; y 1 (t) = t , y 2 (t) = te l 

15. ty" - (1 + t)y' + y = t 2 e 2t , t > 0; ^(0 = 1 + t, y 2 (t) = e l 

16. (1 - t)y" + ty' - y = 2{t - l) 2 e~\ 0 < t < 1; y x (t) = e\ y 2 (t) = t 

17. x 2 y" — 3xy' + 4 y = x 2 lnx, x > 0; yi(x) = x 2 , y 2 (x) = x 2 lnx 








3.6 Variation of Parameters 


191 


18. x 2 y" + xy' + (x 2 - 0.25)y = 3x 3/2 sinx, x > 0; 
yi(x) = x~ 1/2 sinx, y 2 (x) = x _1/2 cosx 

19. (1 — x)y" + xy' — y = g(x), 0 < x < 1; yi(x) = e*, y 2 (*) = * 

20. x 2 /' + x/ + (x 2 — 0.25)y = g(x), x > 0; yi(x) = x -1/2 sinx, y 2 (x) = x _1/2 cosx 

21. Show that the solution of the initial value problem 

L[y 1 = /' + P(t)y' + g(0y = g( 0, y(^o) = ^o, / (*o) = / 0 (i) 

can be written as y = u(t) + u(0, where u and v are solutions of the two initial value 
problems 


L[u\ = 0, 


w(*o) =yo, u\t 0 ) =Jq, 


(ii) 


L[v] = g(t), v(t 0 ) = 0, i/(t 0 ) = 0, 


(hi) 


respectively. In other words, the nonhomogeneities in the differential equation and in the 
initial conditions can be dealt with separately. Observe that u is easy to find if a fundamental 
set of solutions of L[u ] = 0 is known. 


22. By choosing the lower limit of integration in Eq. (28) in the text as the initial point to, show 
that Y (; t ) becomes 


Y(t) = 


C y\(s)y 2 (t) -yi(t)y 2 (s) 
to yi(s)y 2 (s) -y[(s)y 2 (s) 


g(s ) ds. 


Show that Y (t) is a solution of the initial value problem 


L[y]=g(t), y(to) = 0 , /(to) = 0. 


Thus Y can be identified with v in Problem 21. 

23. (a) Use the result of Problem 22 to show that the solution of the initial value problem 

/ + y = g(t), y(t 0 ) = 0, /(to) = o (i) 


y= sin(t — s)g(s) ds. 

JtQ 


(ii) 


(b) Use the result of Problem 21 to find the solution of the initial value problem 

/' + y = g(0, y(0) = yo, /(0) = / 0 . 


24. Use the result of Problem 22 to find the solution of the initial value problem 

L[y] = (D — a)(D - b)y = g(t), y(t 0 ) = 0, /(t 0 ) = 0, 

where a and b are real numbers with a ^ b. 

25. Use the result of Problem 22 to find the solution of the initial value problem 

L[y] = [D 2 - 2ID + (X 2 + n 2 )]y = g(t), y(t 0 ) = 0, y'(t t) ) = 0. 

Note that the roots of the characteristic equation are X±i/x. 

26. Use the result of Problem 22 to find the solution of the initial value problem 

L[y] = (D - afy = g(t), y(t 0 ) = 0, y'(t n ) = 0, 


where a is any real number. 
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27. By combining the results of Problems 24 through 26, show that the solution of the initial 
value problem 

L\y] = (D 2 +bD+ c)y = g(t), y(t 0 ) = 0, y'(t 0 ) = 0, 

where b and c are constants, has the form 

y = <p(t) = f K(t -s)g(s)ds. (i) 

Jt 0 

The function K depends only on the solutions y \ and y 2 of the corresponding homogeneous 
equation and is independent of the nonhomogeneous term. Once K is determined, all 
nonhomogeneous problems involving the same differential operator L are reduced to the 
evaluation of an integral. Note also that although K depends on both t and 5 , only the com¬ 
bination t — s appears, so K is actually a function of a single variable. When we think of g(t) 
as the input to the problem and of 0(0 as the output, it follows from Eq. (i) that the output 
depends on the input over the entire interval from the initial point t 0 to the current value t. 
The integral in Eq. (i) is called the convolution of K and g, and K is referred to as the kernel. 

28. The method of reduction of order (Section 3.4) can also be used for the nonhomogeneous 
equation 

y"+p(t)y' +q(t)y = g(t), (i) 

provided one solution yi of the corresponding homogeneous equation is known. Let 
y = v(t)yi(t) and show that y satisfies Eq. (i) if v is a solution of 

+ [2y[(t) + p{t)yi (0 V = g(t). (ii) 

Equation (ii) is a first order linear equation for v'. By solving this equation, integrating 
the result, and then multiplying by yi(t), you can find the general solution of Eq. (i). 

In each of Problems 29 through 32, use the method outlined in Problem 28 to solve the given 
differential equation. 

29. t 2 y" — 2ty' + 2y = 4t 2 , t > 0; yi(t) = t 

30. t 2 y" + Ity' + 5 y = t, t > 0; yi(t) = r 1 

31. ty" — (1 + t)y' + y = t 2 e 2t , t > 0; y\(t) = 1 + t (see Problem 15) 

32. (1 — t)y" + ty r — y = 2{t — l) 2 e~\ 0 < t < 1; y 1 (t) = e f (see Problem 16) 


3.7 Mechanical and Electrical Vibrations 


One of the reasons why second order linear equations with constant coefficients 
are worth studying is that they serve as mathematical models of some important 
physical processes. Two important areas of application are the fields of mechanical 
and electrical oscillations. For example, the motion of a mass on a vibrating spring, 
the torsional oscillations of a shaft with a flywheel, the flow of electric current in 
a simple series circuit, and many other physical problems are all described by the 
solution of an initial value problem of the form 

ay" + by’ + cy = g(t), y(0) = y 0 , /(0) = y' 0 . (1) 

This illustrates a fundamental relationship between mathematics and physics: 
many physical problems may have the same mathematical model. Thus, once we know 
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how to solve the initial value problem (1), it is only necessary to make appropriate 
interpretations of the constants a, b, and c, and of the functions y and g, to obtain 
solutions of different physical problems. 

We will study the motion of a mass on a spring in detail because understanding the 
behavior of this simple system is the first step in the investigation of more complex 
vibrating systems. Further, the principles involved are common to many problems. 
Consider a mass m hanging at rest on the end of a vertical spring of original length 
/, as shown in Figure 3.7.1. The mass causes an elongation L of the spring in the 
downward (positive) direction. In this static situation there are two forces acting at 
the point where the mass is attached to the spring; see Figure 3.7.2. The gravitational 
force, or weight of the mass, acts downward and has magnitude mg, where g is the 
acceleration due to gravity. There is also a force F s , due to the spring, that acts upward. 
If we assume that the elongation L of the spring is small, the spring force is very nearly 
proportional to L; this is known as Hooke’s 8 law. Thus we write F s = —kL, where 
the constant of proportionality k is called the spring constant, and the minus sign is 
due to the fact that the spring force acts in the upward (negative) direction. Since 
the mass is in equilibrium, the two forces balance each other, which means that 


mg — kL = 0. (2) 

For a given weight w = mg, you can measure L and then use Eq. (2) to determine k. 
Note that k has the units of force/length. 



m v 

u 


FIGURE 3.7.1 A spring-mass system. 

F s - -kL 

o 

w - mg 

FIGURE 3.7.2 Force diagram for a spring-mass system. 


8 Robert Hooke (1635-1703) was an English scientist with wide-ranging interests. His most important 
book, Micrographia, was published in 1665 and described a variety of microscopical observations. Hooke 
first published his law of elastic behavior in 1676 as ceiiinosssttuv; in 1678 he gave the interpretation ut 
tensio sic vis, which means, roughly, “as the force so is the displacement.” 
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In the corresponding dynamic problem, we are interested in studying the motion 
of the mass when it is acted on by an external force or is initially displaced. Let 
u(t), measured positive downward, denote the displacement of the mass from its 
equilibrium position at time t\ see Figure 3.7.1. Then u{t) is related to the forces 
acting on the mass through Newton’s law of motion 

mu" it) = f(t), (3) 

where u" is the acceleration of the mass and / is the net force acting on the mass. 
Observe that both u and / are functions of time. In this dynamic problem there are 
now four separate forces that must be considered. 

1. The weight w = mg of the mass always acts downward. 

2. The spring force F s is assumed to be proportional to the total elongation L + u of the 
spring and always acts to restore the spring to its natural position. If L + u > 0, then 
the spring is extended, and the spring force is directed upward. In this case 

F s = -k(L + u). (4) 

On the other hand, if L + u < 0, then the spring is compressed a distance \L + u\, and 
the spring force, which is now directed downward, is given by F s = k\L + u\. However, 
when L + u < 0, it follows that \L + u\ = — (L + u), so F s is again given by Eq. (4). Thus, 
regardless of the position of the mass, the force exerted by the spring is always expressed 
by Eq. (4). 

3. The damping or resistive force F d always acts in the direction opposite to the direction of 
motion of the mass. This force may arise from several sources: resistance from the air or 
other medium in which the mass moves, internal energy dissipation due to the extension 
or compression of the spring, friction between the mass and the guides (if any) that con¬ 
strain its motion to one dimension, or a mechanical device (dashpot) that imparts a resistive 
force to the mass. In any case, we assume that the resistive force is proportional to the 
speed \du/dt\ of the mass; this is usually referred to as viscous damping. If du/dt > 0, 
then u is increasing, so the mass is moving downward. Then F d is directed upward and is 
given by 

Fd(t) = -yu' it), (5) 

where y is a positive constant of proportionality known as the damping constant. On 
the other hand, if du/dt < 0, then u is decreasing, the mass is moving upward, and F d is 
directed downward. In this case, F d = y\u'(t)\; since \u'(t)\ = it follows that F d (t) 

is again given by Eq. (5). Thus, regardless of the direction of motion of the mass, the 
damping force is always expressed by Eq. (5). 

The damping force may be rather complicated, and the assumption that it is modeled 
adequately by Eq. (5) may be open to question. Some dashpots do behave as Eq. (5) 
states, and if the other sources of dissipation are small, it may be possible to neglect 
them altogether or to adjust the damping constant y to approximate them. An important 
benefit of the assumption (5) is that it leads to a linear (rather than a nonlinear) differential 
equation. In turn, this means that a thorough analysis of the system is straightforward, as 
we will show in this section and the next. 

4. An applied external force F(t ) is directed downward or upward as F{t ) is positive or 
negative. This could be a force due to the motion of the mount to which the spring is 
attached, or it could be a force applied directly to the mass. Often the external force 
is periodic. 
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Taking account of these forces, we can now rewrite Newton’s law (3) as 

mu" (t) = mg + F s (t ) + F d (t) + F(t) 

= mg — k[L + u(t )] — yu'(t) + F(t). (6) 

Since mg — kL = 0 by Eq. (2), it follows that the equation of motion of the mass is 

mu" (t) + yu'(t) + ku(t ) = F(t), (7) 

where the constants ra, y, and k are positive. Note that Eq. (7) has the same form as 
Eq. (1). 

It is important to understand that Eq. (7) is only an approximate equation for the 
displacement u{t). In particular, both Eqs. (4) and (5) should be viewed as approx¬ 
imations for the spring force and the damping force, respectively. In our derivation 
we have also neglected the mass of the spring in comparison with the mass of the 
attached body. 

The complete formulation of the vibration problem requires that we specify two 
initial conditions, namely, the initial position uo and the initial velocity vo of the mass: 

u( 0) = uo , u'{ 0) = vo. (8) 

It follows from Theorem 3.2.1 that these conditions give a mathematical problem 
that has a unique solution. This is consistent with our physical intuition that if the 
mass is set in motion with a given initial displacement and velocity, then its posi¬ 
tion will be determined uniquely at all future times. The position of the mass is 
given (approximately) by the solution of Eq. (7) subject to the prescribed initial 
conditions (8). 


A mass weighing 4 lb stretches a spring 2 in. Suppose that the mass is given an additional 
6 in displacement in the positive direction and then released. The mass is in a medium that 
exerts a viscous resistance of 6 lb when the mass has a velocity of 3 ft/s. Under the assumptions 
discussed in this section, formulate the initial value problem that governs the motion of the 
mass. 

The required initial value problem consists of the differential equation (7) and initial condi¬ 
tions (8), so our task is to determine the various constants that appear in these equations. The 
first step is to choose the units of measurement. Based on the statement of the problem, it is 
natural to use the English rather than the metric system of units. The only time unit mentioned 
is the second, so we will measure t in seconds. On the other hand, both the foot and the inch 
appear in the statement as units of length. It is immaterial which one we use, but having made 
a choice, we must be consistent. To be definite, let us measure the displacement u in feet. 

Since nothing is said in the statement of the problem about an external force, we assume 
that F{t) = 0. To determine m, note that 

w 4 lb 1 lbs 2 

m g 32 ft/s 2 8 ft 

The damping coefficient y is determined from the statement that yu' is equal to 6 lb when u' 
is 3 ft/s. Therefore, 

6 lb „ lb s 
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The spring constant k is found from the statement that the mass stretches the spring by 2 in, 
or 1/6 ft. Thus 


k = 


41b _ lb 

-= 24 —. 

1/6 ft ft 


Consequently, Eq. (7) becomes 

T 2 u! 4- 24 u = 0, 


or 

u" + 16 u! + 192 u = 0. 


The initial conditions are 

u( 0) = §, m'(0) = 0. 


(9) 

( 10 ) 


The second initial condition is implied by the word “released” in the statement of the problem, 
which we interpret to mean that the mass is set in motion with no initial velocity. 


Undamped Free Vibrations. If there is no external force, then F(t) = 0 in Eq. (7). Let 
us also suppose that there is no damping, so that y — 0; this is an idealized config¬ 
uration of the system, seldom (if ever) completely attainable in practice. However, 
if the actual damping is very small, then the assumption of no damping may yield 
satisfactory results over short to moderate time intervals. In this case the equation 
of motion (7) reduces to 

mu" + ku = 0. (11) 

The characteristic equation for Eq. (11) is 

mr 2 + k = 0 

and its roots are r = ± ijkjm. Thus the general solution of Eq. (11) is 

u = A cos coot + B sin coot, (12) 

where 

col = k/m. (13) 

The arbitrary constants A and B can be determined if initial conditions of the form 
(8) are given. 

In discussing the solution of Eq. (11), it is convenient to rewrite Eq. (12) in the 
form 

u = R cos(coot — 8 ), (14) 

or 

u = R cos 8 cos coot + R sin 8 sin coot. (15) 

By comparing Eq. (15) with Eq. (12), we find that A , B , R , and 8 are related by the 
equations 

A=Rcos8, B = Rsin8. (16) 

Thus 

R = Ja 2 + £ 2 , tan S = B/A. (17) 

In calculating 8 , we must take care to choose the correct quadrant; this can be done 
by checking the signs of cos 8 and sin 8 in Eqs. (16). 
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The graph of Eq. (14), or the equivalent Eq. (12), for a typical set of initial conditions 
is shown in Figure 3.7.3. The graph is a displaced cosine wave that describes a periodic, 
or simple harmonic, motion of the mass. The period of the motion is 


T = 


2n /rax 1 / 2 

— =27Z \t) 

ojq V k / 


(18) 


The circular frequency coo = y/k/m, measured in radians per unit time, is called the 
natural frequency of the vibration. The maximum displacement R of the mass from 
equilibrium is the amplitude of the motion. The dimensionless parameter 8 is called 
the phase, or phase angle, and measures the displacement of the wave from its normal 
position corresponding to 8 = 0. 



FIGURE 3.7.3 Simple harmonic motion; u = R cos (coot — 8). 

Note that the motion described by Eq. (14) has a constant amplitude that does not 
diminish with time. This reflects the fact that, in the absence of damping, there is no 
way for the system to dissipate the energy imparted to it by the initial displacement 
and velocity. Further, for a given mass ra and spring constant /c, the system always 
vibrates at the same frequency coo , regardless of the initial conditions. However, the 
initial conditions do help to determine the amplitude of the motion. Finally, observe 
from Eq. (18) that T increases as ra increases, so larger masses vibrate more slowly. 
On the other hand, T decreases as k increases, which means that stiffer springs cause 
the system to vibrate more rapidly. 


Suppose that a mass weighing 10 lb stretches a spring 2 in. If the mass is displaced an additional 
2 in and is then set in motion with an initial upward velocity of 1 ft/s, determine the position 
of the mass at any later time. Also determine the period, amplitude, and phase of the motion. 

The spring constant is k = 10 lb/2 in = 60 lb/ft, and the mass is m = w/g = 10/32 lb s 2 /ft. 
Hence the equation of motion reduces to 

u" + 192 u = 0, (19) 

and the general solution is 

u — A cos(8\/3 t) + B sin(8v^0- 

The solution satisfying the initial conditions w(0) = 1/6 ft and u'( 0) = —1 ft/s is 

1 1 

u = - cos(8V3 1) -— sin(8 V3t). 

6 8^3 


( 20 ) 
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The natural frequency is co 0 = >/l92 = 13.856 rad/s, so the period is T = 2jt/cl>o = 0.45345 s. 
The amplitude R and phase 8 are found from Eqs. (17). We have 


2 _ 1_ J_ _ 19_ 

' “ 36 + 192 “ 576’ 


so R = 0.18162 ft. 


The second of Eqs. (17) yields tan <5 = — V3/4. There are two solutions of this equation, one in 
the second quadrant and one in the fourth. In the present problem, cos 8 > 0 and sin 8 < 0, so 
8 is in the fourth quadrant. In fact, 


8 = —arctan(V3/4) = —0.40864 rad. 


The graph of the solution (20) is shown in Figure 3.7.4. 


u > 



0.2 

C\l 

00 

o 

HI 

u= 0.182 cos(8V3f+ 0.409) 

1 

1 1 r 


0.5\ 

1 \l.5 t 

-0.2 


T= 0.453 , 



1 


FIGURE 3.7.4 An undamped free vibration: u " + 192 u = 0, w(0) = 1/6, u'( 0) = — 1. 


Damped Free Vibrations. If we include the effect of damping, the differential equation 
governing the motion of the mass is 

mu f/ + yu' + ku = 0. (21) 


We are especially interested in examining the effect of variations in the damping 
coefficient y for given values of the mass m and spring constant k. The corresponding 
characteristic equation is 

mr 2 + yr + k = 0, 


and its roots are 


ri,r 2 


—y zb y y 2 — 4 km 
2m 


y 

2m 



( 22 ) 


Depending on the sign of y 2 — 4km, the solution u has one of the following forms: 

y 2 - 4km >0, u = Ae nt + Be r *\ (23) 

y 2 - 4km = 0, u = (A + Bt)e~ Yt/2m \ (24) 

(Akm _ 

y 2 — 4 km <0, u = e~ yt/2m (A cos /it + B sin /it), /i =- > 0. (25) 

2m 

Since m, y, and k are positive, y 2 — 4km is always less than y 2 . Hence, 

if y 2 — 4km > 0, then the values of r\ and r 2 given by Eq. (22) are negative . If 

y 2 — 4km < 0, then the values of r\ and r 2 are complex, but with negative real part. 
Thus, in all cases, the solution u tends to zero as t oo; this occurs regardless of the 
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values of the arbitrary constants A and B —that is, regardless of the initial conditions. 
This confirms our intuitive expectation, namely, that damping gradually dissipates 
the energy initially imparted to the system, and consequently the motion dies out 
with increasing time. 

The most important case is the third one, which occurs when the damping is small. 
If we let A = R cos <5 and B = R sin 8 in Eq. (25), then we obtain 

u = Re~ yt/2m cos {fit - 8). (26) 

The displacement u lies between the curves u = ±Re~ yt/lm \ hence it resembles a 
cosine wave whose amplitude decreases as t increases. A typical example is sketched 
in Figure 3.7.5. The motion is called a damped oscillation or a damped vibration. The 
amplitude factor R depends on m, y, k , and the initial conditions. 


R cos 5 
i 


Re 


L 


-7t/2m 






8 8 + n 8+2 k 8+3n fit 

% ^'-Re- rt,2m 

FIGURE 3.7.5 Damped vibration; u = Re _yr/2m cos {fit — 5). 


Although the motion is not periodic, the parameter /x determines the frequency 
with which the mass oscillates back and forth; consequently, /x is called the quasi 
frequency. By comparing /x with the frequency coo of undamped motion, we find that 

= (4fcm - y 2 ) 1/2 /2m = L_ J^A' 2 ~ 1 _ _2_ ^7) 

y/k/m \ 4 km) ~ 8 km' 


The last approximation is valid when y 2 /4km is small; we refer to this situation as 
“small damping.” Thus the effect of small damping is to reduce slightly the frequency 
of the oscillation. By analogy with Eq. (18), the quantity Td = 27r//x is called the 
quasi period. It is the time between successive maxima or successive minima of 
the position of the mass, or between successive passages of the mass through its 
equilibrium position while going in the same direction. The relation between Td and 
T is given by 


Td _ coo 
Y~J 



(28) 


where again the last approximation is valid when y 2 /4km is small. Thus small damping 
increases the quasi period. 

Equations (27) and (28) reinforce the significance of the dimensionless ratio 
y 2 /4km. It is not the magnitude of y alone that determines whether damping is large 
or small, but the magnitude of y 2 compared to 4 km. When y 2 /4km is small, then 
damping has a small effect on the quasi frequency and quasi period of the motion. 
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On the other hand, if we want to study the detailed motion of the mass for all time, 
then we can never neglect the damping force, no matter how small. 

As y 2 /4km increases, the quasi frequency /i decreases and the quasi period Td 
increases. In fact, /z -> 0 and Td -> oc as y -> 2\[km. As indicated by Eqs. (23), (24), 
and (25), the nature of the solution changes as y passes through the value 2 \fkm. 
The motion with y = 2 \fkm is said to be critically damped. For larger values of y 
the motion is said to be overdamped. In these cases, given by Eqs. (24) and (23), 
respectively, the mass may pass through its equilibrium position at most once (see 
Figure 3.7.6) and then creeps back to it. The mass does not oscillate about equilibrium, 
as it does for small y. Two typical examples of critically damped motion are shown 
in Figure 3.7.6, and the situation is discussed further in Problems 21 and 22. 



FIGURE 3.7.6 Critically damped motions: u" + u' + 0.25 u = 0; u = (A + Bt)e t/2 . 


EXAMPLE 

3 


The motion of a certain spring-mass system is governed by the differential equation 

u" + 0.125m' + u = 0, (29) 

where u is measured in feet and t in seconds. If w(0) = 2 and u'(0) = 0, determine the position 
of the mass at any time. Find the quasi frequency and the quasi period, as well as the time 
at which the mass first passes through its equilibrium position. Also find the time r such that 
\u{t)\ < 0.1 for all t > r. 

The solution of Eq. (29) is 


P ~t /16 


V255 n . V255 
A cos „ „ t + B sin — 7 —t 


16 


16 


To satisfy the initial conditions, we must choose A — 2 and B — 2/V255; hence the solution of 
the initial value problem is 


_ m6 , 0 V255 2 . V255 \ 

u = e t/Lb ( 2 cos ———t H— - sin ^ ^ 11 

16 V255 16 ) 


32 


■(#-* 


( 30 ) 
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FIGURE 3.7.7 Vibration with small damping (solid curve) 
and with no damping (dashed curve). 


where tan 8 = 1/V255, so 8 = 0.06254. The displacement of the mass as a function of time is 
shown in Figure 3.7.7. For purposes of comparison, we also show the motion if the damping 
term is neglected. 

The quasi frequency is /x = V255/16 = 0.998, and the quasi period is T d = 2j t/ii = 6.295 s. 
These values differ only slightly from the corresponding values (1 and 2jt, respectively) for 
the undamped oscillation. This is evident also from the graphs in Figure 3.7.7, which rise 
and fall almost together. The damping coefficient is small in this example: only one-sixteenth 
of the critical value, in fact. Nevertheless, the amplitude of the oscillation is reduced rather 
rapidly. Figure 3.7.8 shows the graph of the solution for 40 < t < 60, together with the graphs 
of u = ±0.1. From the graph it appears that r is about 47.5, and by a more precise calculation 
we find that r = 47.5149 s. 
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FIGURE 3.7.8 Solution of Example 3; determination of the time r after which \u(t)\ < 0.1. 
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To find the time at w hich the mass first passes through its equilibrium position, we refer to 
Eq. (30) and set V255t/16 — 8 equal to 7 t/2 , the smallest positive zero of the cosine function. 
Then, by solving for t, we obtain 


t = 


16 

V255 


( 1 +*) 


1.637 s. 


Electric Circuits. A second example of the occurrence of second order linear differen¬ 
tial equations with constant coefficients is their use as a model of the flow of electric 
current in the simple series circuit shown in Figure 3.7.9. The current /, measured 
in amperes (A), is a function of time t. The resistance R in ohms (£2), the capaci¬ 
tance C in farads (F), and the inductance L in henrys (H) are all positive and are 
assumed to be known constants. The impressed voltage E in volts (V) is a given func¬ 
tion of time. Another physical quantity that enters the discussion is the total charge 
Q in coulombs (C) on the capacitor at time t. The relation between charge Q and 
current I is 

I = dQ/dt. (31) 


Resistance# 



Capacitance C 




Inductance L 


Impressed voltage E(t) 

FIGURE 3.7.9 A simple electric circuit. 


The flow of current in the circuit is governed by Kirchhoff’s 9 second law: In a closed 
circuit the impressed voltage is equal to the sum of the voltage drops in the rest of the 
circuit. 

According to the elementary laws of electricity, we know that 
The voltage drop across the resistor is IR. 

The voltage drop across the capacitor is Q/C. 

The voltage drop across the inductor is Ldl/dt. 

Hence, by Kirchhoff s law, 

L jt +RI+ h Q=m - (32) 


9 Gustav Kirchhoff (1824-1887) was a German physicist and professor at Breslau, Heidelberg, and Berlin. 
He formulated the basic laws of electric circuits about 1845 while still a student at Albertus University in 
his native Konigsberg. In 1857 he discovered that an electric current in a resistanceless wire travels at the 
speed of light. He is also famous for fundamental work in electromagnetic absorption and emission and 
was one of the founders of spectroscopy. 
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The units for voltage, resistance, current, charge, capacitance, inductance, and time 
are all related: 

1 volt = 1 ohm • 1 ampere = 1 coulomb/I farad = 1 henry • 1 ampere/1 second. 
Substituting for I from Eq. (31), we obtain the differential equation 

LQ" + RQ' + ^Q = E{t) (33) 

for the charge Q. The initial conditions are 

Q(t 0 ) = Go, Q\t 0 ) = /(to) = /o. (34) 

Thus we must know the charge on the capacitor and the current in the circuit at some 
initial time to- 

Alternatively, we can obtain a differential equation for the current I by differen- 


dating Eq. (33) with respect to t , and then substituting for dQjdt from Eq. (31). The 

result is 

LI" + RV + ^1 = E\t ), 


(35) 

with the initial conditions 


l ""H 

II 

0 s 

II 

o* 

(36) 

From Eq. (32) it follows that 


T , E(to) - Rio ~ (1/ C)Qo 

4 “ L 

(37) 


Hence /q is also determined by the initial charge and current, which are physically 
measurable quantities. 

The most important conclusion from this discussion is that the flow of current in the 
circuit is described by an initial value problem of precisely the same form as the one 
that describes the motion of a spring-mass system. This is a good example of the uni¬ 
fying role of mathematics: once you know how to solve second order linear equations 
with constant coefficients, you can interpret the results in terms of mechanical vibra¬ 
tions, electric circuits, or any other physical situation that leads to the same problem. 


PROBLEMS In each of Problems 1 through 4, determine coo, R, and 8 so as to write the given expression in 

the form u = R cos (co 0 t — 8). 

1. u = 3cos2£ + 4sin2£ 2. u = — cost + >/3sint 

3. u = 4cos3£ — 2sin3£ 4. u = — 2 cos nt — 3 sin nt 

4R * 1 * * * 5 6 7 - A mass weighing 2 lb stretches a spring 6 in. If the mass is pulled down an additional 3 in 

and then released, and if there is no damping, determine the position u of the mass at any 

time t. Plot u versus t. Find the frequency, period, and amplitude of the motion. 

6 . A mass of 100 g stretches a spring 5 cm. If the mass is set in motion from its equilibrium posi¬ 

tion with a downward velocity of 10 cm/s, and if there is no damping, determine the position 
u of the mass at any time t. When does the mass first return to its equilibrium position? 

7. A mass weighing 3 lb stretches a spring 3 in. If the mass is pushed upward, contracting 

the spring a distance of 1 in, and then set in motion with a downward velocity of 2 ft/s, 
and if there is no damping, find the position u of the mass at any time t. Determine the 
frequency, period, amplitude, and phase of the motion. 
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8. A series circuit has a capacitor of 0.25 x 10 -6 F and an inductor of 1 H. If the initial charge 
on the capacitor is 10 -6 C and there is no initial current, find the charge Q on the capacitor 
at any time t. 

41 9. A mass of 20 g stretches a spring 5 cm. Suppose that the mass is also attached to a viscous 

damper with a damping constant of 400 dyn s/cm. If the mass is pulled down an additional 
2 cm and then released, find its position u at any time t. Plot u versus t. Determine the quasi 
frequency and the quasi period. Determine the ratio of the quasi period to the period of 
the corresponding undamped motion. Also find the time r such that KOI < 0.05 cm for 
all t > r. 

41 10 - A mass weighing 16 lb stretches a spring 3 in. The mass is attached to a viscous damper 
with a damping constant of 2 lb s/ft. If the mass is set in motion from its equilibrium posi¬ 
tion with a downward velocity of 3 in/s, find its position u at any time t. Plot u versus t. 
Determine when the mass first returns to its equilibrium position. Also find the time r 
such that |w(OI < 0.01 in for all t > r. 

11. A spring is stretched 10 cm by a force of 3 N. A mass of 2 kg is hung from the spring and 
is also attached to a viscous damper that exerts a force of 3 N when the velocity of the 
mass is 5 m/s. If the mass is pulled down 5 cm below its equilibrium position and given an 
initial downward velocity of 10 cm/s, determine its position u at any time t. Find the quasi 
frequency /x and the ratio of /x to the natural frequency of the corresponding undamped 
motion. 

12. A series circuit has a capacitor of 10 -5 F, a resistor of 3 x 10 2 £2, and an inductor of 0.2 H. 
The initial charge on the capacitor is 10 -6 C and there is no initial current. Find the charge 
Q on the capacitor at any time t. 

13. A certain vibrating system satisfies the equation u" + yu' + u = 0. Find the value of the 
damping coefficient y for which the quasi period of the damped motion is 50% greater 
than the period of the corresponding undamped motion. 

14. Show that the period of motion of an undamped vibration of a mass hanging from a ver¬ 
tical spring is 27Ty/L/g , where L is the elongation of the spring due to the mass, and g is 
the acceleration due to gravity. 

15. Show that the solution of the initial value problem 

mu" + yu' + ku = 0, u(to) = uq, u'(to) = u' 0 

can be expressed as the sum u = v + w, where v satisfies the initial conditions 
v(to) = uo,v'(to) = 0, w satisfies the initial conditions w(to) = 0, w'(to) = u' Q , and both v 
and w satisfy the same differential equation as u. This is another instance of superposing 
solutions of simpler problems to obtain the solution of a more general problem. 

16. Show that A cos coot + B sin coot can be written in the form r sin(<x>ot — 0). Determine r and 
0 in terms of A and B. If R cos (coot — 8) = r sin(<x> 0 t — 0), determine the relationship among 
R, r, 8, and 0. 

17. A mass weighing 8 lb stretches a spring 1.5 in. The mass is also attached to a damper with 
coefficient y. Determine the value of y for which the system is critically damped; be sure 
to give the units for y. 

18. If a series circuit has a capacitor of C = 0.8 x 10 -6 F and an inductor of L = 0.2 H, find 
the resistance R so that the circuit is critically damped. 

19. Assume that the system described by the equation mu" + yu' + ku = 0 is either critically 
damped or overdamped. Show that the mass can pass through the equilibrium position at 
most once, regardless of the initial conditions. 

Hint: Determine all possible values of t for which u = 0. 
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20. Assume that the system described by the equation mu" + yu f + ku = 0 is critically damped 
and that the initial conditions are u(0) = uo,u'( 0) = u 0 .Ifuo = 0, show that u Oast oo 
but that u is never zero. If uo is positive, determine a condition on i> 0 that will ensure that 
the mass passes through its equilibrium position after it is released. 

21. Logarithmic Decrement, (a) For the damped oscillation described by Eq. (26), show 
that the time between successive maxima is T d = 2tt//x. 

(b) Show that the ratio of the displacements at two successive maxima is given by 
exp (yT d /2m). Observe that this ratio does not depend on which pair of maxima 
is chosen. The natural logarithm of this ratio is called the logarithmic decrement and is 
denoted by A. 

(c) Show that A = ny/mp. Since m , /x, and A are quantities that can be measured easily for 
a mechanical system, this result provides a convenient and practical method for determin¬ 
ing the damping constant of the system, which is more difficult to measure directly. In par¬ 
ticular, for the motion of a vibrating mass in a viscous fluid, the damping constant depends 
on the viscosity of the fluid; for simple geometric shapes the form of this dependence is 
known, and the preceding relation allows the experimental determination of the viscosity. 
This is one of the most accurate ways of determining the viscosity of a gas at high pressure. 

22. Referring to Problem 21, find the logarithmic decrement of the system in Problem 10. 

23. For the system in Problem 17, suppose that A = 3 and T d = 0.3 s. Referring to Problem 
21, determine the value of the damping coefficient y. 

24. The position of a certain spring-mass system satisfies the initial value problem 

| u" + ku = 0, u( 0) = 2, u'( 0) = v. 

If the period and amplitude of the resulting motion are observed to be tt and 3, respectively, 
determine the values of k and v. 

25. Consider the initial value problem 

u" + yu' + u = 0, w(0) = 2, u'(0) = 0. 

We wish to explore how long a time interval is required for the solution to become “neg¬ 
ligible” and how this interval depends on the damping coefficient y. To be more precise, 
let us seek the time r such that \u{t)\ < 0.01 for all t > r. Note that critical damping for 
this problem occurs for y = 2. 

(a) Let y = 0.25 and determine r, or at least estimate it fairly accurately from a plot of 
the solution. 

(b) Repeat part (a) for several other values of y in the interval 0 < y < 1.5. Note that r 
steadily decreases as y increases for y in this range. 

(c) Create a graph of r versus y by plotting the pairs of values found in parts (a) and (b). 
Is the graph a smooth curve? 

(d) Repeat part (b) for values of y between 1.5 and 2. Show that r continues to decrease 
until y reaches a certain critical value y 0 , after which r increases. Find y 0 and the 
corresponding minimum value of r to two decimal places. 

(e) Another way to proceed is to write the solution of the initial value problem in 
the form (26). Neglect the cosine factor and consider only the exponential factor and the 
amplitude R. Then find an expression for r as a function of y. Compare the approximate 
results obtained in this way with the values determined in parts (a), (b), and (d). 

26. Consider the initial value problem 

mu" + yu' + ku = 0, 

Assume that y 2 < 4km. 


w(0) = m 0 , m'(0) = Vq. 
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(a) Solve the initial value problem. 

(b) Write the solution in the form u(t ) = Rexp(—yt/2m) cos(/ri — 5). Determine R in 
terms of m , y, k , u 0 , and u 0 . 

(c) Investigate the dependence of R on the damping coefficient y for fixed values of the 
other parameters. 

27. A cubic block of side / and mass density p per unit volume is floating in a fluid of mass den¬ 
sity po per unit volume, where po > P • If the block is slightly depressed and then released, 
it oscillates in the vertical direction. Assuming that the viscous damping of the fluid and 
air can be neglected, derive the differential equation of motion and determine the period 
of the motion. 

Hint: Use Archimedes’ 10 principle: an object that is completely or partially submerged 
in a fluid is acted on by an upward (buoyant) force equal to the weight of the displaced 
fluid. 

41 28. The position of a certain undamped spring-mass system satisfies the initial value problem 

u" + 2u = 0, w(0) = 0, u'( 0) = 2. 


(a) Find the solution of this initial value problem. 

(b) Plot u versus t and u' versus t on the same axes. 

(c) Plot u' versus u\ that is, plot u(t) and u!(t) parametrically with t as the parameter. 
This plot is known as a phase plot, and the uu '-plane is called the phase plane. Observe 
that a closed curve in the phase plane corresponds to a periodic solution u(t). What is the 
direction of motion on the phase plot as t increases? 

41 29. The position of a certain spring-mass system satisfies the initial value problem 

u" + f u' + 2u = 0, w(0) = 0, u'( 0) = 2. 


(a) Find the solution of this initial value problem. 

(b) Plot u versus t and u' versus t on the same axes. 

(c) Plot u' versus u in the phase plane (see Problem 28). Identify several corresponding 
points on the curves in parts (b) and (c). What is the direction of motion on the phase plot 
as t increases? 


30. In the absence of damping, the motion of a spring-mass system satisfies the initial value 
problem 


mu" + ku = 0, w(0) = a , u'( 0) = b. 


(a) Show that the kinetic energy initially imparted to the mass is mb 2 /2 and that the 
potential energy initially stored in the spring is ka 2 /2, so that initially the total energy in 
the system is (ka 2 + mb 2 )/ 2. 

(b) Solve the given initial value problem. 

(c) Using the solution in part (b), determine the total energy in the system at any time t. 
Your result should confirm the principle of conservation of energy for this system. 


10 Archimedes (287-212 BC) was the foremost of the ancient Greek mathematicians. He lived in Syracuse 
on the island of Sicily. His most notable discoveries were in geometry, but he also made important contri¬ 
butions to hydrostatics and other branches of mechanics. His method of exhaustion is a precursor of the 
integral calculus developed by Newton and Leibniz almost two millennia later. He died at the hands of a 
Roman soldier during the Second Punic War. 
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31. Suppose that a mass m slides without friction on a horizontal surface. The mass is attached 
to a spring with spring constant k , as shown in Figure 3.7.10, and is also subject to viscous 
air resistance with coefficient y. Show that the displacement u{t) of the mass from its 
equilibrium position satisfies Eq. (21). How does the derivation of the equation of motion 
in this case differ from the derivation given in the text? 


u{t) 


k 

L 

m 

i 




FIGURE 3.7.10 A spring-mass system. 


41 32. In the spring-mass system of Problem 31, suppose that the spring force is not given by 
Hooke’s law but instead satisfies the relation 

F s = — {ku + eu 3 ), 

where k > 0 and e is small but may be of either sign. The spring is called a hardening spring 
if e > 0 and a softening spring if e < 0. Why are these terms appropriate? 

(a) Show that the displacement u{t ) of the mass from its equilibrium position satisfies the 
differential equation 

mu" + yu! + ku + eu 3 = 0. 

Suppose that the initial conditions are 

u{ 0) = 0, u'{ 0) = 1. 

In the remainder of this problem, assume that m = 1, k = 1, and y = 0. 

(b) Find u(t) when 6 = 0 and also determine the amplitude and period of the motion. 

(c) Let 6 = 0.1. Plot a numerical approximation to the solution. Does the motion appear 
to be periodic? Estimate the amplitude and period. 

(d) Repeat part (c) for e = 0.2 and e = 0.3. 

(e) Plot your estimated values of the amplitude A and the period T versus e. Describe 
the way in which A and T , respectively, depend on e. 

(f) Repeat parts (c), (d), and (e) for negative values of 6. 


3.8 Forced Vibrations 


We will now investigate the situation in which a periodic external force is applied 
to a spring-mass system. The behavior of this simple system models that of many 
oscillatory systems with an external force due, for example, to a motor attached to 
the system. We will first consider the case in which damping is present and will look 
later at the idealized special case in which there is assumed to be no damping. 

Forced Vibrations with Damping. The algebraic calculations can be fairly complicated in 
this kind of problem, so we will begin with a relatively simple example. 
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EXAMPLE 

1 


Suppose that the motion of a certain spring-mass system satisfies the differential equation 

u" + u' + 1.25u = 3 cos t (1) 


and the initial conditions 

w(0) = 2, u'( 0) = 3. (2) 


Find the solution of this initial value problem and describe the behavior of the solution for 
large t. 

The homogeneous equation corresponding to Eq. (1) has the characteristic equation 
r 2 + r + 1.25 = 0 with roots r = — 0.5 =b i. Thus the general solution u c (t) of this homogeneous 
equation is 

u c (t) = c\e~ t/2 cos t + c 2 e~ t/2 sin t. (3) 

A particular solution of Eq. (1) has the form U(t) = A cost + Bsint, where A and B 
are found by substituting U(t) for u in Eq. (1). We have U'(t ) = — A sin t + B cos t and 
U"(t) = —A cos t — B sin t. Thus, from Eq. (1) we obtain 


(0.25A + B) cos t + (—A + 0.25 B) sin t = 3 cos t. 


Consequently, A and B must satisfy the equations 

0.25 A + B = 3, -A + 0.255 = 0, 


with the result that A = 12/17 and B = 48/17. Therefore, the particular solution is 

U(t) = Yi cos t + if s in t, (4) 

and the general solution of Eq. (1) is 

u = u c (t) + U(t) = C\e~ t/2 cos t + c 2 e~ t/2 sin t + cos t + sin t. (5) 

The remaining constants c\ and c 2 are determined by the initial conditions (2). From Eq. (5) 
we have 

zr(0) = C\ + — 2, u '( 0) = —\c\ + c 2 + =3, 

so Ci = 22/17 and c 2 = 14/17. Thus we finally obtain the solution of the given initial value 
problem, namely, 


u = Yje t/2 cos t+^e t/2 sin t + ^ cos t + || sin t. (6) 

The graph of the solution (6) is shown by the black curve in Figure 3.8.1. 

It is important to note that the solution consists of two distinct parts. The first two terms on 
the right side of Eq. (6) contain the exponential factor e~ t/2 \ as a result they rapidly approach 
zero. It is customary to call these terms transient. The remaining terms in Eq. (6) involve only 
sines and cosines, so they represent an oscillation that continues indefinitely. We refer to them 
as a steady state. The solid and dashed blue curves in Figure 3.8.1 show the transient and the 
steady state parts of the solution, respectively. The transient part comes from the solution 
of the homogeneous equation corresponding to Eq. (1) and is needed to satisfy the initial 
conditions. The steady state is the particular solution of the full nonhomogeneous equation. 
After a fairly short time, the transient is vanishingly small and the full solution is essentially 
indistinguishable from the steady state. 
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FIGURE 3.8.1 Solution of the initial value problem (1), (2): 
u" + u' + 1.25 u = 3 cos t, u( 0) = 2, u'( 0) = 3. 


The equation of motion of a general spring-mass system subject to an external 
force F{t) is [Eq. (7) in Section 3.7] 

mu" (t) + yu'(t) + ku(t ) = F(t), (7) 

where m , y, and k are the mass, damping coefficient, and spring constant of the spring- 
mass system. Suppose now that the external force is given by F 0 cos cot , where E 0 and 
co are positive constants representing the amplitude and frequency, respectively, of 
the force. Then Eq. (7) becomes 

mu" + yu' + ku = Fo cos cot. (8) 

Solutions of Eq. (8) behave very much like the solution in the preceding example. 
The general solution of Eq. (8) must have the form 

u = c\U\(t ) + c 2 w 2 (0 + A cos cot + B sin cot = u c (t) + U(t). (9) 

The first two terms on the right side of Eq. (9) are the general solution u c (t) of 
the homogeneous equation corresponding to Eq. (8), and the latter two terms are 
a particular solution U(t) of the full nonhomogeneous equation. The coefficients 
A and B can be found, as usual, by substituting these terms into the differen¬ 
tial equation (8), while the arbitrary constants c\ and C 2 are available to satisfy 
initial conditions, if any are prescribed. The solutions u\(t) and U 2 (t) of the homo¬ 
geneous equation depend on the roots r\ and r 2 of the characteristic equation 
mr 2 + yr + k = 0. Since m, y, and k are all positive, it follows that r\ and r 2 either 
are real and negative or are complex conjugates with negative real part. In either 
case, both u\(t) and w 2 (0 approach zero as t oo. Since u c (t) dies out as t increases, 
it is called the transient solution. In many applications, it is of little importance and 
(depending on the value of y) may well be undetectable after only a few seconds. 

The remaining terms in Eq. (9)—namely, U{t) = A cos cot + B sin cot —do not die 
out as t increases but persist indefinitely, or as long as the external force is applied. 
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They represent a steady oscillation with the same frequency as the external force 
and are called the steady state solution or the forced response. The transient solution 
enables us to satisfy whatever initial conditions may be imposed. With increasing 
time, the energy put into the system by the initial displacement and velocity is dis¬ 
sipated through the damping force, and the motion then becomes the response of 
the system to the external force. Without damping, the effect of the initial conditions 
would persist for all time. 

It is convenient to express U ( t ) as a single trigonometric term rather than as a sum 
of two terms. Recall that we did this for other similar expressions in Section 3.7. Thus 
we write 

U(t) = R cos {cot — 8). (10) 


The amplitude R and phase 8 depend directly on A and B and indirectly on the 
parameters in the differential equation (8). It is possible to show, by straightforward 
but somewhat lengthy algebraic computations, that 



cos 8 = 


m(col — co 2 ) 
A 


. « yv 

sind = —, 
A 


(ii) 


where 



co 2 ) 2 + y 2 co 2 


and col = k/m. 


( 12 ) 


Recall that coo is the natural frequency of the unforced system in the absence of 
damping. 

We now investigate how the amplitude R of the steady state oscillation depends on 
the frequency co of the external force. Substituting from Eq. (12) into the expression 
for R in Eq. (11) and executing some algebraic manipulations, we find that 



where T = y 2 /mk. Observe that the quantity Rk/Fo is the ratio of the amplitude R 
of the forced response to Fo/k, the static displacement of the spring produced by a 
force Fq. 

For low frequency excitation—that is, as co -> 0—it follows from Eq. (13) that 
Rk/F$ -> 1 or R -> F^/k. At the other extreme, for very high frequency excitation, 
Eq. (13) implies that R -> 0 as co -> oo. At an intermediate value of co the amplitude 
may have a maximum. To find this maximum point, we can differentiate R with respect 
to co and set the result equal to zero. In this way we find that the maximum amplitude 
occurs when co = co max , where 


co 


2 

max 


= (On 


Y 

2m 2 


= 



(14) 


Note that co max < coo and that co max is close to coo when y is small. The maximum 
value of R is 

R max = ~ F ° (\ \ Y 2 

ycooy/l — ( y 2 /4mk ) Y M o \ 8mk 

where the last expression is an approximation for small y. If y 2 /mk > 2, then co max as 
given by Eq. (14) is imaginary; in this case the maximum value of R occurs for co = 0, 
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and R is a monotone decreasing function of co. Recall that critical damping occurs 
when y 2 /mk = 4. 

For small y it follows from Eq. (15) that R max = Fo/ycoo • Thus, for lightly damped 
systems, the amplitude R of the forced response when co is near cdq is quite large 
even for relatively small external forces, and the smaller the value of y, the more 
pronounced is this effect. This phenomenon is known as resonance, and it is often 
an important design consideration. Resonance can be either good or bad, depending 
on the circumstances. It must be taken very seriously in the design of structures, 
such as buildings and bridges, where it can produce instabilities that might lead to 
the catastrophic failure of the structure. On the other hand, resonance can be put 
to good use in the design of instruments, such as seismographs, that are intended to 
detect weak periodic incoming signals. 

Figure 3.8.2 contains some representative graphs of Rk/F$ versus co/coq for several 
values of T = y 2 /mk. The graph corresponding to T = 0.015625 is included because 
this is the value of T that occurs in Example 2 below. Note particularly the sharp 
peak in the curve corresponding to T = 0.015625 near co/coo = 1. The limiting case 
as T -> 0 is also shown. It follows from Eq. (13), or from Eqs. (11) and (12), that 
R -> Fo/m\col — co 2 \ as y -> 0 and hence Rk/F$ is asymptotic to the vertical line 
co = coo, as shown in the figure. As the damping in the system increases, the peak 
response gradually diminishes. 



FIGURE 3.8.2 Forced vibration with damping: amplitude of steady 
state response versus frequency of driving force; F = y 2 /mk. 

Figure 3.8.2 also illustrates the usefulness of dimensionless variables. You can easily 
verify that each of the quantities Rk/Fo,co/coo, and F is dimensionless. The importance 
of this observation is that the number of significant parameters in the problem has 
been reduced to three rather than the five that appear in Eq. (8). Thus only one 
family of curves, of which a few are shown in Figure 3.8.2, is needed to describe the 
response-versus-frequency behavior of all systems governed by Eq. (8). 

The phase angle 8 also depends in an interesting way on co. For co near zero, it follows 
from Eqs. (11) and (12) that cos 8 = 1 and sin <5 = 0. Thus <5 = 0, and the response is 
nearly in phase with the excitation, meaning that they rise and fall together and, 
in particular, assume their respective maxima nearly together and their respective 
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minima nearly together. For go = goo we find that cos 5 = 0 and sin 5 = 1, so 5 = it/2. 
In this case the response lags behind the excitation by 7r/2; that is, the peaks of 
the response occur 7 t/ 2 later than the peaks of the excitation, and similarly for the 
valleys. Finally, for go very large, we have cos 5 = — 1 and sin 5 = 0. Thus 5 = tv, so that 
the response is nearly out of phase with the excitation; this means that the response 
is minimum when the excitation is maximum, and vice versa. Figure 3.8.3 shows 
the graphs of 5 versus go/goo for several values of F. For small damping, the phase 
transition from near 5 = 0 to near 5 = n occurs rather abruptly, whereas for larger 
values of the damping parameter, the transition takes place more gradually. 



FIGURE 3.8.3 Forced vibration with damping: phase of steady 
state response versus frequency of driving force; F = y 2 /mk. 


EXAMPLE 

2 


Consider the initial value problem 

u" + 0.125i/ + u = 3 cos cot , u( 0) = 2, u'( 0) = 0. (16) 

Show plots of the solution for different values of the forcing frequency co , and compare them 
with corresponding plots of the forcing function. 

For this system we have co 0 = 1 and F = 1/64 = 0.015625. Its unforced motion was discussed 
in Example 3 of Section 3.7, and Figure 3.7.7 shows the graph of the solution of the unforced 
problem. Figures 3.8.4,3.8.5, and 3.8.6 show the solution of the forced problem (16) for co = 0.3, 
co = 1, and co = 2, respectively. The graph of the corresponding forcing function is also shown 
in each figure. In this example the static displacement, F 0 /k, is equal to 3. 

Figure 3.8.4 shows the low frequency case, co/coq = 0.3. After the initial transient response is 
substantially damped out, the remaining steady state response is essentially in phase with the 
excitation, and the amplitude of the response is somewhat larger than the static displacement. 
To be specific, R = 3.2939 and 5 = 0.041185. 

The resonant case, co/co 0 = 1, is shown in Figure 3.8.5. Here the amplitude of the steady state 
response is eight times the static displacement, and the figure also shows the predicted phase 
lag of 7t/2 relative to the external force. 

The case of comparatively high frequency excitation is shown in Figure 3.8.6. Observe that 
the amplitude of the steady forced response is approximately one-third the static displacement 
and that the phase difference between the excitation and the response is approximately tt. More 
precisely, we find that R = 0.99655 and that 5 = 3.0585. 
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Solution Forcing function 

FIGURE 3.8.4 A forced vibration with damping; solution of 
Eq. (16) with co = 0.3: u" + 0.125 u' + u = 3 cos 0.3 1, u( 0) = 2, u!( 0) = 0. 



Forcing function Solution 

FIGURE 3.8.5 A forced vibration with damping; solution of 


Eq. (16) with co = 1: u" + 0.125w' + u = 3 cos t , w(0) = 2, u'( 0) = 0. 



Forcing function Solution 

FIGURE 3.8.6 A forced vibration with damping; solution of 
Eq. (16) with co = 2: u" + 0.125 u' + u = 3 cos 2 1, u( 0) = 2, u!( 0) = 0. 
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Forced Vibrations Without Damping. We now assume that y = 0 in Eq. (8), thereby 
obtaining the equation of motion of an undamped forced oscillator, 

mu" + ku = Fq cos cot. (17) 


The form of the general solution of Eq. (17) is different, depending on whether the 
forcing frequency go is different from or equal to the natural frequency coo = Jk/m 
of the unforced system. First consider the case go / coo\ then the general solution of 
Eq. (17) is 

F 0 

u = c\ cos coot + C 2 sin coot H-«-—cos cot. (18) 

ra(&>Q — go 2 ) 


The constants c\ and C 2 are determined by the initial conditions. The resulting motion 
is, in general, the sum of two periodic motions of different frequencies (coo and co) 
and different amplitudes as well. 

It is particularly interesting to suppose that the mass is initially at rest, so that 
the initial conditions are m( 0) = 0 and u'( 0) = 0. Then the energy driving the sys¬ 
tem comes entirely from the external force, with no contribution from the initial 
conditions. In this case it turns out that the constants c\ and C 2 in Eq. (18) are 
given by 


ci - - 


Fo 


m(ooQ — go 2 ) 


C2 = o, 


(19) 


and the solution of Eq. (17) is 


u = 


Fo 


m(ooQ — go 2 ) 


(cos cot — COS coot). 


( 20 ) 


This is the sum of two periodic functions of different periods but the same 
amplitude. Making use of the trigonometric identities for cos (A ± B) with 
A = (goq + co)t /2 and B = (coo — oo)t/2 , we can write Eq. (20) in the form 


u = 


2Fo 


m(ooQ — go 2 ) 


sin 


(coo ~ co)t 


sin 


(goo + CO)t 


( 21 ) 


If \goo~ go\ is small, then cooco is much greater than \coo — co\. Consequently, 
sin(&>o + co)t/2 is a rapidly oscillating function compared to sin(&>o — co)t/2. Thus the 
motion is a rapid oscillation with frequency (coo + co)/2 but with a slowly varying 
sinusoidal amplitude 

2Fo . (coq — co)t 

-o-T- Sm -^- * 

m\coQ — co 2 1 2 


This type of motion, possessing a periodic variation of amplitude, exhibits what is 
called a beat. For example, such a phenomenon occurs in acoustics when two tuning 
forks of nearly equal frequency are excited simultaneously. In this case the peri¬ 
odic variation of amplitude is quite apparent to the unaided ear. In electronics, the 
variation of the amplitude with time is called amplitude modulation. 


EXAMPLE 

3 


Solve the initial value problem 

u" + u = 0.5 cos 0.8£, u( 0) = 0, i/(0) = 0, 


( 22 ) 


and plot the solution. 
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In this case co 0 = 1, co = 0.8, and F 0 = 0.5, so from Eq. (21) the solution of the given 
problem is 

u = 2.77778(sin0.10(sin0.90- (23) 

A graph of this solution is shown in Figure 3.8.7. The amplitude variation has a slow frequency 
of 0.1 and a corresponding slow period of 207T. Note that a half-period of 107i corresponds to a 
single cycle of increasing and then decreasing amplitude. The displacement of the spring-mass 
system oscillates with a relatively fast frequency of 0.9, which is only slightly less than the 
natural frequency co 0 . 

Now imagine that the forcing frequency co is increased, say, to co = 0.9. Then the slow 
frequency is halved to 0.05, and the corresponding slow half-period is doubled to 207T. The 
multiplier 2.7778 also increases substantially, to 5.2632. However, the fast frequency is only 
marginally increased, to 0.95. Can you visualize what happens as co takes on values closer and 
closer to the natural frequency co 0 = 1? 



u" + u = 0.5cos0.8t, w(0) = 0, u'(0) = 0; u = 2.77778(sin0.1t)(sin0.90. 


Now let us return to Eq. (17) and consider the case of resonance, where co = coo ; 
that is, the frequency of the forcing function is the same as the natural frequency of the 
system. Then the nonhomogeneous term Fo cos cot is a solution of the homogeneous 
equation. In this case the solution of Eq. (17) is 


u — c\ cos co^t + C 2 sin coot + 


_Fo_ 

2mcoo 


^sin coot. 


(24) 


Consider the following example. 
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Solve the initial value problem 

EXAMPLE 

4 u" + u = 0.5 cos t , u( 0) = 0, u'( 0) = 0, (25) 

and plot the graph of the solution. 

The general solution of the differential equation is 

u = c\ cos t + c 2 sin t + 0.25t sin t, 

and the initial conditions require that c\ = = 0. Thus the solution of the given initial value 

problem is 

w = 0.25tsinL (26) 

The graph of the solution is shown in Figure 3.8.8. 



u" + u = 0.5 cos t, u( 0) = 0, u'( 0) = 0; u = 0.25 1 sin t. 


Because of the term t sin coot , the solution (24) predicts that the motion will become 
unbounded as t oc regardless of the values of c\ and C 2 , and Figure 3.8.8 bears this 
out. Of course, in reality, unbounded oscillations do not occur, because the spring 
cannot stretch infinitely far. Moreover, as soon as u becomes large, the mathemat¬ 
ical model on which Eq. (17) is based is no longer valid, since the assumption that 
the spring force depends linearly on the displacement requires that u be small. As 
we have seen, if damping is included in the model, the predicted motion remains 
bounded; however, the response to the input function Fo cos cot may be quite large if 
the damping is small and co is close to mo. 
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PROBLEMS In each of Problems 1 through 4, write the given expression as a product of two trigonometric 
functions of different frequencies. 

1. cos9t —cos7t 2. sin7t —sin6t 

3. cos 7Tt + cos 2nt 4. sin3t + sin4t 

5. A mass weighing 4 lb stretches a spring 1.5 in. The mass is given a positive displacement of 
2 in from its equilibrium position and released with no initial velocity. Assuming that there 
is no damping and that the mass is acted on by an external force of 2 cos 3 1 lb, formulate 
the initial value problem describing the motion of the mass. 

6. A mass of 5 kg stretches a spring 10 cm. The mass is acted on by an external force of 
10sin(t/2) N (newtons) and moves in a medium that imparts a viscous force of 2 N 
when the speed of the mass is 4 cm/s. If the mass is set in motion from its equilibrium 
position with an initial velocity of 3 cm/s, formulate the initial value problem describing 
the motion of the mass. 

7. (a) Find the solution of Problem 5. 

(b) Plot the graph of the solution. 

(c) If the given external force is replaced by a force 4 sin cot of frequency co , find the value 
of co for which resonance occurs. 

4fl (a) Find the solution of the initial value problem in Problem 6. 

(b) Identify the transient and steady state parts of the solution. 

(c) Plot the graph of the steady state solution. 

(d) If the given external force is replaced by a force of 2 cos cot of frequency co, find the 
value of co for which the amplitude of the forced response is maximum. 

9. If an undamped spring-mass system with a mass that weighs 6 lb and a spring constant 
1 lb/in is suddenly set in motion at t = 0 by an external force of 4 cos It lb, determine the 
position of the mass at any time, and draw a graph of the displacement versus t. 

10. A mass that weighs 8 lb stretches a spring 6 in. The system is acted on by an external force 
of 8 sin 8 1 lb. If the mass is pulled down 3 in and then released, determine the position of the 
mass at any time. Determine the first four times at which the velocity of the mass is zero. 

11. A spring is stretched 6 in by a mass that weighs 8 lb. The mass is attached to a dashpot 
mechanism that has a damping constant of 0.25 lb-s/ft and is acted on by an external force 
of 4 cos 2 1 lb. 

(a) Determine the steady state response of this system. 

(b) If the given mass is replaced by a mass m , determine the value of m for which the 
amplitude of the steady state response is maximum. 

12. A spring-mass system has a spring constant of 3 N/m. A mass of 2 kg is attached to the 
spring, and the motion takes place in a viscous fluid that offers a resistance numerically 
equal to the magnitude of the instantaneous velocity. If the system is driven by an external 
force of (3 cos 3t — 2 sin 3 1) N, determine the steady state response. Express your answer 
in the form R cos (cot — 8). 

13. In this problem we ask you to supply some of the details in the analysis of a forced damped 
oscillator. 

(a) Derive Eqs. (10), (11), and (12) for the steady state solution of Eq. (8). 

(b) Derive the expression in Eq. (13) for Rk/F 0 . 

(c) Show that co^ ax and R max are given by Eqs. (14) and (15), respectively. 

14. Find the velocity of the steady state response given by Eq. (10). Then show that the velocity 
is maximum when co = coq. 
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15. Find the solution of the initial value problem 


where 


u" + u = F{t ), u( 0) = 0, u'(0) = 0, 


F(t) = 


F 0 t, 
F 0 (2 tt 
0 , 


0 , 


0 < t < 7T, 
71 < t < 2jt, 
2tz < t. 


Hint: Treat each time interval separately, and match the solutions in the different 
intervals by requiring u and u' to be continuous functions of t. 

16. A series circuit has a capacitor of 0.25 x 10 -6 F, a resistor of 5 x 10 3 £2, and an inductor of 
1H. The initial charge on the capacitor is zero. If a 12-volt battery is connected to the cir¬ 
cuit and the circuit is closed at t = 0, determine the charge on the capacitor at t = 0.001 s, 
at t = 0.01 s, and at any time t. Also determine the limiting charge as t oo. 

17. Consider a vibrating system described by the initial value problem 


u" + \u! + 2u = 2 cos cot, w(0) = 0, u!( 0) = 2. 


(a) Determine the steady state part of the solution of this problem. 

(b) Find the amplitude A of the steady state solution in terms of co. 

(c) Plot A versus co. 

(d) Find the maximum value of A and the frequency co for which it occurs. 

18. Consider the forced but undamped system described by the initial value problem 

u" + u = 3 cos cot, u( 0) = 0, u'( 0) = 0. 

(a) Find the solution u(t ) for co ^ 1. 

(b) Plot the solution u{t) versus t for co = 0.7, co = 0.8, and co = 0.9. Describe how the 
response u(t ) changes as co varies in this interval. What happens as co takes on val¬ 
ues closer and closer to 1? Note that the natural frequency of the unforced system 
is coq = 1. 

19. Consider the vibrating system described by the initial value problem 

u" + u = 3 cos cot, u( 0) = 1, u'( 0) = 1. 

(a) Find the solution for co ^ 1. 

(b) Plot the solution u(t ) versus t for co = 0.7, co = 0.8, and co = 0.9. Compare the results 
with those of Problem 18; that is, describe the effect of the nonzero initial conditions. 

20. For the initial value problem in Problem 18, plot u' versus u for co = 0.7, co = 0.8, and 
co = 0.9. Such a plot is called a phase plot. Use a t interval that is long enough so that the 
phase plot appears as a closed curve. Mark your curve with arrows to show the direction 
in which it is traversed as t increases. 

Problems 21 through 23 deal with the initial value problem 

u" + 0.125 u' + 4 u = F(t), u( 0) = 2, u'( 0) = 0. 

In each of these problems: 

(a) Plot the given forcing function F(t) versus t, and also plot the solution u(t ) versus t on the 
same set of axes. Use a t interval that is long enough so the initial transients are substantially 
eliminated. Observe the relation between the amplitude and phase of the forcing term and 
the amplitude and phase of the response. Note that co 0 = ^k/m = 2. 

(b) Draw the phase plot of the solution; that is, plot u' versus u. 
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F{t ) = 3cos(t/4) 

F(t) = 3 cos 2 1 
F(t) = 3 cos 6t 

A spring-mass system with a hardening spring (Problem 32 of Section 3.7) is acted on by 
a periodic external force. In the absence of damping, suppose that the displacement of the 
mass satisfies the initial value problem 

u" + u + = cos cot , w(0) = 0, w'(0) = 0. 

(a) Let co = 1 and plot a computer-generated solution of the given problem. Does the 
system exhibit a beat? 

(b) Plot the solution for several values of co between 1 /2 and 2. Describe how the solution 
changes as co increases. 

Suppose that the system of Problem 24 is modified to include a damping term and that 
the resulting initial value problem is 

u" + \u! + u + \u 3 = cos cot, w(0) = 0, u'{ 0) = 0. 

(a) Plot a computer-generated solution of the given problem for several values of co 
between 1/2 and 2, and estimate the amplitude R of the steady response in each case. 

(b) Using the data from part (a), plot the graph of R versus co. For what frequency co is 
the amplitude greatest? 

(c) Compare the results of parts (a) and (b) with the corresponding results for the linear 
spring. 


Coddington, E. A .,An Introduction to Ordinary Differential Equations (Englewood Cliffs, NJ: Prentice- 
Hall, 1961; New York: Dover, 1989). 

There are many books on mechanical vibrations and electric circuits. One that deals with both is 

Close, C. M., and Frederick, D. K., Modeling and Analysis of Dynamic Systems (3rd ed.) (New York: Wiley, 
2001). 

A classic book on mechanical vibrations is 

Den Hartog, J. P. , Mechanical Vibrations (4th ed.) (New York: McGraw-Hill, 1956; New York; Dover, 1985). 
A more recent, intermediate-level book is 

Thomson, W. T., Theory of Vibrations with Applications (5th ed.) (Englewood Cliffs, NJ: Prentice-Hall, 
1997). 

An elementary book on electric circuits is 

Bobrow, L. S., Elementary Linear Circuit Analysis (New York: Oxford University Press, 1996). 
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Higher Order Linear 
Equations 


4 


The theoretical structure and methods of solution developed in the preceding chapter 
for second order linear equations extend directly to linear equations of third and 
higher order. In this chapter we briefly review this generalization, taking particular 
note of those instances where new phenomena may appear, because of the greater 
variety of situations that can occur for equations of higher order. 


4.1 General Theory of nth Order Linear Equations 


An nth order linear differential equation is an equation of the form 

d n y d n ~ 1 y dy . . 

+ P \(o fan-i + ■ ■ ’+^ >n ~ i ^~dt = (i) 

We assume that the functions Pq, ..., P n , and G are continuous real-valued functions 
on some interval /: a < t < /?, and that Po is nowhere zero in this interval. Then, 
dividing Eq. (1) by Po(t), we obtain 

d n y d n ~ x y dy 

L[y] = dr +Pl ^~dt^ + "' + Pn ^ (t) It +Pn{t)y = g<t) ' ( 2 ) 

The linear differential operator L of order n defined by Eq. (2) is similar to the second 
order operator introduced in Chapter 3. The mathematical theory associated with 
Eq. (2) is completely analogous to that for the second order linear equation; for this 
reason we simply state the results for the nth order problem. The proofs of most of 
the results are also similar to those for the second order equation and are usually left 
as exercises. 
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Since Eq. (2) involves the /?th derivative of y with respect to t , it will, so to speak, 
require n integrations to solve Eq. (2). Each of these integrations introduces an 
arbitrary constant. Hence we expect that to obtain a unique solution it is necessary 
to specify n initial conditions 

y(to)=yo, y\t 0 )=y' 0 , /" -1) (fo) =3'o" -1) > ( 3 ) 

where to may be any point in the interval I and yo,y' 0 ,..., y ^~ 11 is any set of prescribed 
real constants. The following theorem, which is similar to Theorem 3.2.1, guarantees 
that the initial value problem (2), (3) has a solution and that it is unique. 


Theorem 4.1.1 If the functions pup 2 , • • • ,Pn, and g are continuous on the open interval/, then there 

exists exactly one solution y = 0(0 of the differential equation (2) that also satisfies 
the initial conditions (3), where to is any point in /. This solution exists throughout 
the interval I. 


We will not give a proof of this theorem here. However, if the coefficients pi, ... ,p n 
are constants, then we can construct the solution of the initial value problem (2), (3) 
much as in Chapter 3; see Sections 4.2 through 4.4. Even though we may find a solution 
in this case, we do not know that it is unique without the use of Theorem 4.1.1. A 
proof of the theorem can be found in Ince (Section 3.32) or Coddington (Chapter 6). 

The Homogeneous Equation. As in the corresponding second order problem, we first 
discuss the homogeneous equation 

L\y\ = y (n) +p 1 (t)y (n ~ 1) + ■ ■ ■ + Pn -i(t)y' + p n (t)y = 0. (4) 

If the functions yi, y 2 ,...,y n are solutions of Eq. (4), then it follows by direct 
computation that the linear combination 

y = Ciyi(t) + C 2 y 2 (t) + • • • + c n y n (t), (5) 

where ci,..., c n are arbitrary constants, is also a solution of Eq. (4). It is then natural 
to ask whether every solution of Eq. (4) can be expressed as a linear combination 
of yi, ... ,y n . This will be true if, regardless of the initial conditions (3) that are 
prescribed, it is possible to choose the constants ci,... ,c n so that the linear com¬ 
bination (5) satisfies the initial conditions. That is, for any choice of the point to in /, 
and for any choice ofyoAo* • • • >.ycf _1) ’ we mus t t> e a ble to determine ci,... ,c n so that 
the equations 

ciyi(t 0 ) +-b c n y n (to) = yo 

ciyi(to) H-b c n y' n (to) = y'o 

( 6 ) 

Ciyf - 1 ) (*o) + • • • + Cny^ito) = y { o~ l) 

are satisfied. Equations (6) can be solved uniquely for the constants ci,...,c w , 
provided that the determinant of coefficients is not zero. On the other hand, if the 
determinant of coefficients is zero, then it is always possible to choose values of 
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Theorem 4.1.2 


EXAMPLE 

1 


yo, y' 0 , • • • ,y\)~ V) so that Eqs. (6) do not have a solution. Therefore a necessary and 
sufficient condition for the existence of a solution of Eqs. (6) for arbitrary values of 
yo, y ' 0 ,... * s ^at the Wronskian 


W(yu...,y n ) = 


y i 

/i 


(«—i) 

y\ 


y 2 

y'2 


(n- 1) 

y\ 


y n 

y'n 


y { r X) 


(7) 


is not zero at t = to. Since to can be any point in the interval /, it is necessary and 
sufficient that W(yi, y 2 , ... ,y n ) be nonzero at every point in the interval. Just as for 
the second order linear equation, it can be shown that if yi, y 2 , ... ,y n are solutions 
of Eq. (4), then W(yi,y 2 , ... ,y n ) either is zero for every t in the interval I or else is 
never zero there; see Problem 20. Hence we have the following theorem. 


If the functions pi,p 2 , •.. ,p n are continuous on the open interval /, if the functions 
yi,y 2 , • • • ,y n are solutions of Eq. (4), and if W(yi,y 2 , ■.. ,y n )(t) ^ 0 for at least one 
point in /, then every solution of Eq. (4) can be expressed as a linear combination 
of the solutions yi,y 2 , • • • ,y n - 


A set of solutions yi,... ,y n of Eq. (4) whose Wronskian is nonzero is referred to 
as a fundamental set of solutions. The existence of a fundamental set of solutions can 
be demonstrated in precisely the same way as for the second order linear equation 
(see Theorem 3.2.5). Since all solutions of Eq. (4) are of the form (5), we use the term 
general solution to refer to an arbitrary linear combination of any fundamental set 
of solutions of Eq. (4). 

Linear Dependence and Independence. We now explore the relationship between funda¬ 
mental sets of solutions and the concept of linear independence, a central idea in the 
study of linear algebra. The functions f\ ,/ 2 ,... ,f n are said to be linearly dependent 
on an interval I if there exists a set of constants ku • • •, k n , not all zero, such that 

kifi(t) + ^ 2 / 2(0 + • • • + k n f n (t) = 0 (8) 

for all t in I. The functions / 1 ,... ,f n are said to be linearly independent on I if they 
are not linearly dependent there. 


Determine whether the functions /i (0 = l,/ 2 (0 = t, and /3(f) = t 2 are linearly independent or 
dependent on the interval I : — 00 < t < 00 . 

Form the linear combination 

hfi (t) + £2/2(0 + £ 3 / 3(0 = £1 + k 2 t + £3/, 

and set it equal to zero to obtain 


k\ -\- k,2t T kit 2 — 0. 


( 9 ) 
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EXAMPLE 

2 


If Eq. (9) is to hold for all t in /, then it must certainly be true at any three distinct points in I. 
Any three points will serve our purpose, but it is convenient to choose t = 0, t — 1, and t = — 1. 
Evaluating Eq. (9) at each of these points, we obtain the system of equations 

k x =0, 

k\ + k 2 + k 3 = 0, (10) 

k\ — k 2 + k 3 = 0. 

From the first of Eqs. (10) we note that k\ = 0; then from the other two equations it follows 
that k 2 = k 3 = 0 as well. Therefore, there is no set of constants k x ,k 2 ,k 3 , not all zero, for 
which Eq. (9) holds even at the three chosen points, much less throughout /. Thus the given 
functions are not linearly dependent on /, so they must be linearly independent. Indeed, they 
are linearly independent on any interval. This can be established just as in this example, possibly 
using a different set of three points. 


Determine whether the functions 

h (0 = 1, hit) = 2 + t, hit) = 3 — t 2 , and hit) = 4 t + t 2 

are linearly independent or dependent on any interval /. 

Form the linear combination 

kifi(t) + k 2 f 2 (t ) + k 3 f 3 (t) + k x f x (t) = k\ + k 2 {2 + 1) + ^(3 — t 2 ) + k^(At + t 2 ) 

= ( k\ + 2k 2 + 3k 2 ) + (k 2 + Ak^)t + (—k 2 + k^t 2 . (11) 

For this expression to be zero throughout an interval, it is certainly sufficient to require that 

k\ + 2 k 2 + 3k 2 = 0, k 2 + 4&4 = 0, —k 3 + = 0. 

These three equations, with four unknowns, have many solutions. For instance, if /c 4 = 1, then 
k 3 = l,k 2 = —4, and k\ = 5. If we use these values for the coefficients in Eq. (11), then we 
have 

5 / i ( 0 - 4 / 2 ( 0 +/ 3 ( 0 +/ 4(0 = 0 

for each value of t. Thus the given functions are linearly dependent on every interval. 


The concept of linear independence provides an alternative characterization of 
fundamental sets of solutions of the homogeneous equation (4). Suppose that the 
functions yu...,y n are solutions of Eq. (4) on an interval /, and consider the equation 

k\yiit)4 -+ k n y n it) = 0. (12) 

By differentiating Eq. (12) repeatedly, we obtain the additional n — 1 equations 

kiy'i(t) H- +k n y' n it) = 0, 


k 1 y^- 1 \t) + --- + k n y^- 1 \t) = 0. 


(13) 


The system consisting of Eqs. (12) and (13) is a system of n linear algebraic equations 
for the n unknowns k \,..., k n . The determinant of coefficients for this system is the 
Wronskian W(yu ... ,y n )(t) of yi ,... ,y n . This leads to the following theorem. 
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Theorem 4.1.3 If yi(t)i •• - ,ynit) is a fundamental set of solutions of Eq. (4) 

L[y] = y M + Pl (t)y (n - 1) + ■■■ + Pn - 1 (t)y' +p„(t)y = 0 

on an interval /, then .. ,y n (t ) are linearly independent on 1. Conversely, if 

yi(t),... ,y n (t ) are linearly independent solutions of Eq. (4) on /, then they form a 
fundamental set of solutions on I. 


To prove this theorem, first suppose that yi(t ),... ,y n (t) is a fundamental set of 
solutions of Eq. (4) on I. Then the Wronskian W(yi,... ,y n )(t ) ^ 0 for every t in 
I. Hence the system (12), (13) has only the solution k\ = • • • = k n = 0 for every t 
in /. Thus yi(t ),... ,y n (t) cannot be linearly dependent on I and must therefore be 
linearly independent there. 

To demonstrate the converse, let yi(t), ... 9 y n (t) be linearly independent on I. To 
show that they form a fundamental set of solutions, we need to show that their 
Wronskian is never zero in I. Suppose that this is not true; then there is at least one 
point to where the Wronskian is zero. At this point the system (12), (13) has a nonzero 
solution; let us denote it by k *,..., k*. Now form the linear combination 

0(0 = &i>i(0 H-+ Ky n (t). (14) 

Then </>(t) satisfies the initial value problem 

L[y] = 0, y(A)) = 0, y'(t 0 ) = 0, ..., / n_1) Oo) = 0. (15) 

The function 0 satisfies the differential equation because it is a linear combination of 
solutions; it satisfies the initial conditions because these are just the equations in the 
system (12), (13) evaluated at to- However, the function y(t) = 0 for all t in I is also 
a solution of this initial value problem, and by Theorem 4.1.1, the solution is unique. 
Thus 0(t) = 0 for all t in 1. Consequently, yi(t ),... ,y n (t) are linearly dependent on 
/, which is a contradiction. Hence the assumption that there is a point where the 
Wronskian is zero is untenable. Therefore, the Wronskian is never zero on /, as was 
to be proved. 

Note that for a set of functions/i, ...,/„ that are not solutions of Eq. (4), the con¬ 
verse part of Theorem 4.1.3 is not necessarily true. They may be linearly independent 
on I even though the Wronskian is zero at some points, or even every point, but 
with different sets of constants k\,...,k n at different points. See Problem 25 for an 
example. 

The Nonhomogeneous Equation. Now consider the nonhomogeneous equation (2) 

L[y] = y (n) +pi(t)y (n ~ 1) + ■■■ + p„(t)y = g(t). 

If Y\ and Y 2 are any two solutions of Eq. (2), then it follows immediately from the 
linearity of the operator L that 

m - Y 2 m = mm - L[Y 2 m = g(o - g(o = o. 

Hence the difference of any two solutions of the nonhomogeneous equation (2) is a 
solution of the homogeneous equation (4). Since any solution of the homogeneous 
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PROBLEMS 


equation can be expressed as a linear combination of a fundamental set of solutions 
yi ,... ,y n , it follows that any solution of Eq. (2) can be written as 

y = ciyiit) + c 2 y 2 (t) + • • • + c n y n (t) + Y(t), (16) 

where Y is some particular solution of the nonhomogeneous equation (2). The linear 
combination (16) is called the general solution of the nonhomogeneous equation (2). 

Thus the primary problem is to determine a fundamental set of solutions yi,...,y n 
of the homogeneous equation (4). If the coefficients are constants, this is a fairly 
simple problem; it is discussed in the next section. If the coefficients are not constants, 
it is usually necessary to use numerical methods such as those in Chapter 8 or series 
methods similar to those in Chapter 5. These tend to become more cumbersome as 
the order of the equation increases. 

To find a particular solution Y(t) in Eq. (16), the methods of undetermined coef¬ 
ficients and variation of parameters are again available. They are discussed and 
illustrated in Sections 4.3 and 4.4, respectively. 

The method of reduction of order (Section 3.4) also applies to nth order linear 
equations. If yi is one solution of Eq. (4), then the substitution y = v(t)yi(t) leads to 
a linear differential equation of order n — 1 for v' (see Problem 26 for the case when 
n = 3). However, if n > 3, the reduced equation is itself at least of second order, and 
only rarely will it be significantly simpler than the original equation. Thus, in practice, 
reduction of order is seldom useful for equations of higher than second order. 


In each of Problems 1 through 6, determine intervals in which solutions are sure to exist. 

1. y (4) + 4 y'" + 3 y = t 2. ty"' + (sin t)y" + 3 y = cos t 

3. t(t — 1 )y (4) + e l y" + 4t 2 y = 0 4. y'" + ty" + t 2 y' + t 3 y = In t 

5. (x — 1 )y (4) + (x + 1 )y" + (tanx)y = 0 6. (x 2 — 4)y (6) + x 2 y"' + 9y = 0 

In each of Problems 7 through 10, determine whether the given functions are linearly depen¬ 
dent or linearly independent. If they are linearly dependent, find a linear relation among 
them. 

7. fi(t) =2t — 3, f 2 (t) = ? + 1, Ht) = 2t 2 -t 
8- fi(t) =2t — 3, f 2 (t) = 2t 2 + 1, f 2 (t)=3t 2 + t 

9 . fi(t) = 2t—3, m = f + 1 , m = 2 f-t, m = t 2 +t+i 

10. fot) =2t-3, f 2 (t) = t 3 + l, fc(t)=2t 2 -t, f A (t) = t 2 + t + \ 

In each of Problems 11 through 16, verify that the given functions are solutions of the 
differential equation, and determine their Wronskian. 

11. /" +y' = 0; 1, cost, sku 

12. y (4) + y" = 0; 1, t, cos t, sin t 

13. y'" + 2y" - y' - 2y = 0; e~ 2t 

14. y (4) + 2y //; + y" = 0; 1, t, ete^ 

15. xy’" — y" = 0; 1, x, x 3 

16. x 3 y"' + x 2 y" — 2xy' + 2y = 0; x, x 2 , 1/x 

17. Show that W (5, sin 2 1, cos 2t) = 0 for all t. Can you establish this result without direct 
evaluation of the Wronskian? 

18. Verify that the differential operator defined by 

L[y] = + • • ■ + p n (t)y 
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is a linear differential operator. That is, show that 

L\c x y x + c 2 y 2 ] =c 1 L[y 1 ] + c 2 L[y 2 ], 

where yi and y 2 are n-times-differentiable functions and C\ and c 2 are arbitrary constants. 
Hence, show that if y 3 , y 2 ,... ,y n are solutions of L[y] = 0, then the linear combination 
c\y\ H- V c n y n is also a solution of L[y] = 0. 

19. Let the linear differential operator L be defined by 

L[y] = a 0 y M + a iy (n ~ X) + • • • + a„y, 

where ao,ai,... ,a n are real constants. 

(a) Find L[t n ]. 

(b) Find L[e rt ]. 

(c) Determine four solutions of the equation y (4) — 5 y" + 4y = 0. Do you think the four 
solutions form a fundamental set of solutions? Why? 

20. In this problem we show how to generalize Theorem 3.2.7 (Abel’s theorem) to higher 
order equations. We first outline the procedure for the third order equation 

/" +pi(0y" +P 2 (t)/ +Ps(t)y = o. 

Let yi,y 2 , and y 3 be solutions of this equation on an interval I. 

(a) If W = W(y\,y 2 ,y 3 ), show that 



y i 

yi 

ya 

W' = 

y'i 

y'2 

y '3 


y"( 

y'i 

y'3 


Hint: The derivative of a 3-by-3 determinant is the sum of three 3-by-3 determinants 
obtained by differentiating the first, second, and third rows, respectively. 

(b) Substitute for y f ”,y 2 , and y'^ from the differential equation; multiply the first row by 
/? 3 , multiply the second row by p 2 , and add these to the last row to obtain 

W' = -pi(t)W. 


(c) Show that 

W(y 1 ,y 2 ,y 3 )(t) = cexp J p x {t)dt 

It follows that W is either always zero or nowhere zero on I. 

(d) Generalize this argument to the nth order equation 

y (n) + Pi{t)y (n ~ X) + • • ■ + Pnit)y = 0 


with solutions yi,...,y n - That is, establish Abel’s formula 

W(y lt . ,.,y„)(t) = cexp | - J pi(t) dt 

for this case. 


In each of Problems 21 through 24, use Abel’s formula (Problem 20) to find the Wronskian of 
a fundamental set of solutions of the given differential equation. 

21. y m + 2y" - / - 3y = 0 22. y (4) + y = 0 

23. ty”' + 2y" -y' + ty = 0 24. t 2 y (4) + ty"' + / - 4y = 0 
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25. (a) Show that the functions fit) = t 2 \t\ and g(t ) = t 3 are linearly dependent on 
0 < t < 1 and on — 1 < t < 0. 

(b) Show that fit) and git) are linearly independent on — 1 < t < 1. 

(c) Show that W(f,g)(t) is zero for all t in — 1 < t < 1. 

26. Show that if yi is a solution of 

y'" + pi(0/' + + ps (t)y = 0, 

then the substitution y = yi(t)v(t) leads to the following second order equation for v': 
y\v m + (3y[ + p x y\)v" + (3 y'l + 2piy[ + p 2 yi)v' = 0. 

In each of Problems 27 and 28, use the method of reduction of order (Problem 26) to solve 
the given differential equation. 

27. (2 - t)y m + (2 t - 3)/' - + y = 0, t < 2; y x (0 = ^ 

28. t 2 (t + 3)y //; - 3t(t + 2)y" + 6(1 + t)y' - 6y = 0, t > 0; yi(t) = t 2 , y 2 (0 = t 3 


4.2 Homogeneous Equations with Constant Coefficients 

Consider the nth order linear homogeneous differential equation 

L[y ] = a 0 y (n) + +-1- a„_i/ + = 0, (1) 

where ao,ai,...,a n are real constants and ao / 0. From our knowledge of second 
order linear equations with constant coefficients, it is natural to anticipate that y = e rt 
is a solution of Eq. (1) for suitable values of r. Indeed, 

L[e rt ] = e rt (aor n + a\r n ~ x +- f- a n -\r + a n ) = e rt Z{r) (2) 

for all r, where 

Z(r) = a 0 r n + a 1 r n ~ 1 H-f- (3) 

For those values of r for which Z(r) = 0, it follows that L[e rt ] = 0 and y = e rt is a 
solution of Eq. (1). The polynomial Z(r) is called the characteristic polynomial, and 
the equation Z(r) = 0 is the characteristic equation of the differential equation (1). 
Since ao 0, we know that Z(r) is a polynomial of degree n and therefore has n zeros, 1 
say, ri, r 2 , ..., r w , some of which may be equal. Hence we can write the characteristic 
polynomial in the form 

Z(r) = a 0 (r - n)(r - r 2 ) • • • (r - r n ). (4) 


1 An important question in mathematics for more than 200 years was whether every polynomial equation 
has at least one root. The affirmative answer to this question, the fundamental theorem of algebra, was 
given by Carl Friedrich Gauss (1777-1855) in his doctoral dissertation in 1799, although his proof does 
not meet modern standards of rigor. Several other proofs have been discovered since, including three by 
Gauss himself. Today, students often meet the fundamental theorem of algebra in a first course on complex 
variables, where it can be established as a consequence of some of the basic properties of complex analytic 
functions. 
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Real and Unequal Roots. If the roots of the characteristic equation are real and no 
two are equal, then we have n distinct solutions e nt , e nt ,..., e Tnt of Eq. (1). If these 
functions are linearly independent, then the general solution of Eq. (1) is 

y = Cl e nt + C 2 e rit 4 - b C n e rnt . (5) 

One way to establish the linear independence of e nt , e n \..., e Ynt is to evaluate their 
Wronskian determinant. Another way is outlined in Problem 40. 


EXAMPLE 

1 


Find the general solution of 

y (4) + y'" - ly" - y' + 6y = 0. (6) 

Also find the solution that satisfies the initial conditions 

y(0) - 1, y'(O) = 0, y"(0) = -2, /'(0) = -1 (7) 

and plot its graph. 

Assuming that y = e rt , we must determine r by solving the polynomial equation 

r 4 + r 3 — 7r 2 — r + 6 = 0. (8) 

The roots of this equation are r\ = 1, r 2 = — 1, r 3 = 2, and r 4 = —3. Therefore, the general 
solution of Eq. (6) is 

y = c\e l + + c 3 e 2t + c 4 e~ 3t . (9) 


The initial conditions (7) require that ci,..., c 4 satisfy the four equations 

Cl T C 2 ~b C3 + C4 — 1 , 

Ci — C2 + 2c 3 — 3c 4 = 0, 

Ci + c 2 + 4 c 3 + 9c 4 = —2, 

Ci — c 2 + 8 c 3 — 27c 4 = —1. 


By solving this system of four linear algebraic equations, we find that 


Cl = T ’ 


C 2= Tl’ 


C3 = — 3 , 


c 4 — 


Thus the solution of the initial value problem is 


y — 8 ^ ^ 12 ^ 8 ^ 


The graph of the solution is shown in Figure 4.2.1. 


( 10 ) 


( 11 ) 



FIGURE 4.2.1 Solution of the initial value problem (6), (7): 

_y< 4 > + y"' — ly" — y' + 6y = 0, y(0) = 1, /(0) = 0, y"( 0) =-2, /"(0) = -1. 
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As Example 1 illustrates, the procedure for solving an ni\v order linear differential 
equation with constant coefficients depends on finding the roots of a corresponding 
nth degree polynomial equation. If initial conditions are prescribed, then a system 
of n linear algebraic equations must be solved to determine the proper values of 
the constants ci,... ,c w . Each of these tasks becomes much more complicated as n 
increases, and we have omitted the detailed calculations in Example 1. Computer 
assistance can be very helpful in such problems. 

For third and fourth degree polynomials there are formulas, 2 analogous to the 
formula for quadratic equations but more complicated, that give exact expressions for 
the roots. Root-finding algorithms are readily available on calculators and computers. 
Sometimes they are included in the differential equation solver, so that the process of 
factoring the characteristic polynomial is hidden and the solution of the differential 
equation is produced automatically. 

If you are faced with the need to factor the characteristic polynomial by hand, here 
is one result that is sometimes helpful. Suppose that the polynomial 

dor n + d\r n ■*■ + ••• + d n -\T + ci n — 0 (12) 

has integer coefficients. If r = p/q is a rational root, where p and q have no common 
factors, then p must be a factor of a n , and q must be a factor of do. For example, in 
Eq. (8) the factors of do are ±1 and the factors of d n are ±1, ±2, ±3, and ±6. Thus 
the only possible rational roots of this equation are ±1, ±2, ±3, and ±6. By testing 
these possible roots, we find that 1, —1,2, and —3 are actual roots. In this case there 
are no other roots, since the polynomial is of fourth degree. If some of the roots are 
irrational or complex, as is usually the case, then this process will not find them, but 
at least the degree of the polynomial can be reduced by dividing the polynomial by 
the factors corresponding to the rational roots. 

If the roots of the characteristic equation are real and different, we have seen 
that the general solution (5) is simply a sum of exponential functions. For large values 
of t the solution is dominated by the term corresponding to the algebraically largest 
root. If this root is positive, then solutions become exponentially unbounded, whereas 
if it is negative, then solutions tend exponentially to zero. Finally, if the largest root 
is zero, then solutions approach a nonzero constant as t becomes large. Of course, 
for certain initial conditions, the coefficient of the otherwise dominant term may be 
zero; then the nature of the solution for large t is determined by the next largest root. 

Complex Roots. If the characteristic equation has complex roots, they must occur in 
conjugate pairs, A d= ip ,since the coefficients do,d\,d 2 ,...,d n are real numbers. Pro¬ 
vided that none of the roots is repeated, the general solution of Eq. (1) is still of the 


2 The method for solving the cubic equation was apparently discovered by Scipione dal Ferro (1465- 
1526) about 1500, although it was first published in 1545 by Girolamo Cardano (1501-1576) in his Ars 
Magna. This book also contains a method for solving quartic equations that Cardano attributes to his pupil 
Ludovico Ferrari (1522-1565). The question of whether analogous formulas exist for the roots of higher 
degree equations remained open for more than two centuries, until 1826, when Niels Abel showed that 
no general solution formulas can exist for polynomial equations of degree five or higher. A more general 
theory was developed by Evariste Galois (1811-1832) in 1831, but unfortunately it did not become widely 
known for several decades. 
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EXAMPLE 

2 


form of Eq. (5). However, just as for the second order equation (Section 3.3), we can 
replace the complex-valued solutions e and by the real-valued solutions 

e xt cos fit , e xt sin fit (13) 

obtained as the real and imaginary parts of e (A+ ^ )r . Thus, even though some of 
the roots of the characteristic equation are complex, it is still possible to express the 
general solution of Eq. (1) as a linear combination of real-valued solutions. 


Find the general solution of 

y (4) -y = 0. (14) 

Also find the solution that satisfies the initial conditions 

y(0) = 7/2, y'(0) = -4, y"(0) = 5/2, y"'(0) = -2 (15) 

and draw its graph. 

Substituting e rt for y, we find that the characteristic equation is 

r 4 — 1 = (r 2 — l)(r 2 + 1) = 0. 

Therefore, the roots are r = 1,-1, /, — /, and the general solution of Eq. (14) is 

y = cie* + C 2 e~ l + C 3 cos t + C 4 sin t. 

If we impose the initial conditions (15), we obtain 

c\ — 0, Ci — 3, c 3 = 1/2, c 4 = —1; 
thus the solution of the given initial value problem is 

y = 3e~ l + \ cos t - sin t. (16) 

The graph of this solution is shown in Figure 4.2.2. 



FIGURE 4.2.2 Solution of the initial value problem (14), (15): 

/ 4 ) - y = 0, y( 0) = 7/2, /(0) = -4, y"( 0) = 5/2, y"'( 0) = -2. 

Observe that the initial conditions (15) cause the coefficient c\ of the exponentially growing 
term in the general solution to be zero. Therefore, this term is absent in the solution (16), 
which describes an exponential decay to a steady oscillation, as Figure 4.2.2 shows. However, 
if the initial conditions are changed slightly, then c\ is likely to be nonzero, and the nature of 
the solution changes enormously. For example, if the first three initial conditions remain the 
same, but the value of /"(0) is changed from —2 to —15/8, then the solution of the initial value 
problem becomes 

y — + \ cos t - E sin t. 


(17) 





232 


Chapter 4 . Higher Order Linear Equations 


The coefficients in Eq. (17) differ only slightly from those in Eq. (16), but the exponentially 
growing term, even with the relatively small coefficient of 1/32, completely dominates the 
solution by the time t is larger than about 4 or 5. This is clearly seen in Figure 4.2.3, which 
shows the graphs of the two solutions (16) and (17). 



FIGURE 4.2.3 The blue curve is the solution of the initial value problem (14), (15) 
and is the same as the curve in Figure 4.2.2. The black curve is the solution of the 
modified problem in which the last initial condition is changed to /"(0) = —15/8. 


Repeated Roots. If the roots of the characteristic equation are not distinct—that is, 
if some of the roots are repeated—then the solution (5) is clearly not the general 
solution of Eq. (1). Recall that if r\ is a repeated root for the second order linear 
equation ayy" + a\y' + ayy = 0, then two linearly independent solutions are e nt and 
te rit . For an equation of order n , if a root of Z(r) = 0, say r = r\ , has multiplicity s 
(where s < n), then 

e rit , te n ‘, t 2 e n ‘, t s ~ l e rit (18) 

are corresponding solutions of Eq. (1). See Problem 41 for a proof of this statement, 
which is valid whether the repeated root is real or complex. 

Note that a complex root can be repeated only if the differential equation (1) is 
of order four or higher. If a complex root X-\- ip is repeated s times, the complex 
conjugate X — ip is also repeated s times. Corresponding to these 2s complex-valued 
solutions, we can find 2s real-valued solutions by noting that the real and imaginary 
parts of ^<7+*^,... 5 are a i so h near iy independent solutions: 

e xt cos pt, e xt sin pt , te xt cos pt, te u sin pt, 
f-i e xt CQS ^ f~ x e u sin pt. 

Hence the general solution of Eq. (1) can always be expressed as a linear combination 
of n real-valued solutions. Consider the following example. 


Find the general solution of 

EXAMPLE y(4) + 2/ T y = 0. (19) 

** The characteristic equation is 

r 4 + 2r 2 + 1 = (r 2 + l)(r 2 + 1) = 0. 

The roots are r = i, i, — /, —i, and the general solution of Eq. (19) is 
y = ci cos t + c 2 sin t + cyt cos t + c 4 t sin t. 
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EXAMPLE 

4 


PROBLEMS 


In determining the roots of the characteristic equation, it may be necessary to 
compute the cube roots, the fourth roots, or even higher roots of a (possibly com¬ 
plex) number. This can usually be done most conveniently by using Euler’s formula 
e lt = cos t + i sin t and the algebraic laws given in Section 3.3. This is illustrated in the 
following example. 


Find the general solution of 


y (4) + y = 0. 


The characteristic equation is 


r * * 4 + 1 = 0. 


( 20 ) 


To solve the equation, we must compute the fourth roots of —1. Now —1, thought of as a 
complex number, is — 1 + 0/. It has magnitude 1 and polar angle tt. Thus 

—1 = cos 7i + i sin n = e l7t . 


Moreover, the angle is determined only up to a multiple of 2tt. Thus 

—1 = cos(7r + 2m7i) + /sin(7r + 2m7i) = e i(7r+2m7r) , 
where m is zero or any positive or negative integer. Thus 

(-1) 1/4 = e 'W 4 + m */ 2 > = COS Q + i sin . 

The four fourth roots of —1 are obtained by setting m = 0,1,2, and 3; they are 


1 + i — 1 + i — 1 — i 1 — i 

y/2 ' V2 ’ \/2 V2 ■ 

It is easy to verify that, for any other value of m, we obtain one of these four roots. For 
example, corresponding to m = 4, we obtain (1 + i)/V2. The general solution of Eq. (20) is 


y = e 11 ^ f ci cos -^= + c 2 sin ~^= 
1 V2 V2 


)+e-W, 


f . t 

c 3 cos —— + c 4 sin —= 
V2 V2 


( 21 ) 


In conclusion, we note that the problem of finding all the roots of a polynomial 
equation may not be entirely straightforward, even with computer assistance. For 
instance, it may be difficult to determine whether two roots are equal or merely 
very close together. Recall that the form of the general solution is different in these 
two cases. 

If the constants ao, a \,..., a n in Eq. (1) are complex numbers, the solution of Eq. (1) 
is still of the form (4). In this case, however, the roots of the characteristic equation 
are, in general, complex numbers, and it is no longer true that the complex conjugate 
of a root is also a root. The corresponding solutions are complex-valued. 


In each of Problems 1 through 6, express the given complex number in the form 

R( cos 0 + i sin 0) = Re l9 . 

1. 1 + / 2. -1 + V3/ 

3. -3 4. -i 

5. V3 — i 6. —1 — i 
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In each of Problems 7 through 10, follow the procedure illustrated in Example 4 to determine 
the indicated roots of the given complex number. 

7. I 1 / 3 8 . (1 - i) 1/2 

9. 1 1/4 10. [2(cos7t/ 3 + / sin 7r/3)] 1/2 


In each of Problems 11 through 28, find the general solution of the given differential equation. 


41 

41 


11 . /" - 

-y"-y'+y = 

0 


12. 

/" ■ 

- 3y" 

+ 3 /- 

-y = 0 

13. 2/" 

+ 

& 

1 

1 

\y = 0 


14. 

y(4) 

-4f 

"+ 4 / 

= 0 

15. / 6) 

+ y = 0 



16. 

y(4) 

-5/ 

' + 4 y-. 

= 0 

17. / 6) 

- 3/ 4) + 3/' - 

y = 0 


18. 

y(6) 


= 0 


19. / 5) 

- 3/ 4) + 3/" - 

- 3y" + 2/ = 0 

20. 

y(4) 

-8/ 

= 0 


21. y® 

+ 8/ 4) + 16y = 

= 0 


22. 

y(4) 

+ 2/ 

’+y = 

0 

23. /" - 

- 5/' + 3 y'+y 

= 0 


24. 

y>" . 

f 5/ 

+ 6/ + 2y = ( 

25. 18y 

+ 21/' + 14/ 

’ + 4y = 0 

41 

26. 

y(4) 

-If 

" + 6 y" 

+ 30/ 


27. 12/ 4 > + 31/"+ 75/'+ 37/+ 5y = 0 jfl 28. / 4) + 6 /" + 17/' + 22/ + 14y = 0 


In each of Problems 29 through 36, find the solution of the given initial value problem, and 
plot its graph. How does the solution behave as t oo? 


41 

29. 

y»> . 

+ 

II 

O 

y(P) 

= 0, /(0) 

= 1, /'( 0) 


2 



41 

30. 

y(4) 

+ y = 0; 

y( 0) 

= 0 , /( 0 ) 

= 0, /'(0) 

= 

- 1 , y' 

"(0) 

= 0 

41 

31. 

y(4) 

_ 4 /" + 4/' 

= 0; 

y(D = 

- 1 , /(D = 

2, 

/'(i) 

= 0. 

, /"(1) = 0 

41 

32. 

f" 

1 

+ 

1 

'rS 

= 0; 

y( 0) = 

2 , /( 0 ) = - 

-1, 

y"(0) 

= - 

-2 

41 

33. 

2_y (4) - /" - 9/' 

+ 4/ 

+ 4y = 0; 

y(0) = -2 

1 

/(0) = 

: 0, 

/(0) = - 2 , 

41 

34. 

4/ 

'+/ + 5y = 

0; 

y(0) = 2 , 

/(0) = 1 , 

/' 

(0) = - 

1 


41 

35. 

6y" 

' + 5/'+/ = 

= 0; 

y(0) = - 

2 , /( 0 ) = 2 

, 

y"(0) = 

= 0 


41 

36. 

y( 4 ) 

+ 6/" + 17y 

11 

+ 

& 

<N 

+ 

O 

3 

II 

: 1, 

/(0) 

= - 

1 ° 

X. 

3 

II 

0 


/"(0) = 3 


37. Show that the general solution of y (4) — y = 0 can be written as 


y — c\ cos t + C 2 sin t + C 3 cosh t + C 4 sinh t. 


Determine the solution satisfying the initial conditions y(0) = 0, /(0) = 0, y"(0) = 1, 
/"(0) = 1. Why is it convenient to use the solutions cosh t and sinh t rather than e f and 

e~n 

38. Consider the equation y (4) — y = 0. 

(a) Use Abel’s formula [Problem 20(d) of Section 4.1] to find the Wronskian of a 
fundamental set of solutions of the given equation. 

(b) Determine the Wronskian of the solutions e\ e ~ l , cos t, and sin t. 

(c) Determine the Wronskian of the solutions cosh t, sinh t, cos t, and sin t. 

39. Consider the spring-mass system, shown in Figure 4.2.4, consisting of two unit masses 
suspended from springs with spring constants 3 and 2, respectively. Assume that there is 
no damping in the system. 

(a) Show that the displacements U\ and u 2 of the masses from their respective equilibrium 
positions satisfy the equations 


u" + 5u\ = 2u 2 , 


u '2 + 2u 2 = 2u \. 


(i) 



4.2 Homogeneous Equations with Constant Coefficients 


235 


(b) Solve the first of Eqs. (i) for u 2 and substitute into the second equation, thereby 
obtaining the following fourth order equation for u\\ 

u J 4) + lu![ + 6u\ = 0. (ii) 

Find the general solution of Eq. (ii). 

(c) Suppose that the initial conditions are 

*q(0) = 1, *4(0) = 0, u 2 (0) = 2, u 2 (0) = 0. (iii) 

Use the first of Eqs. (i) and the initial conditions (iii) to obtain values for u'[{ 0) and u'{'( 0). 
Then show that the solution of Eq. (ii) that satisfies the four initial conditions on u\ is 
ui(t) = cos t. Show that the corresponding solution u 2 is u 2 (t) = 2cos t. 

(d) Now suppose that the initial conditions are 

*q(0) = —2, u[(0) = 0, u 2 (0) = 1, u 2 (0) = 0. (iv) 

Proceed as in part (c) to show that the corresponding solutions are u\ ( t ) = —2 cos t 
and u 2 (t) = cos V 6 1 . 

(e) Observe that the solutions obtained in parts (c) and (d) describe two distinct modes 
of vibration. In the first, the frequency of the motion is 1, and the two masses move in 
phase, both moving up or down together; the second mass moves twice as far as the first. 
The second motion has frequency \/6, and the masses move out of phase with each other, 
one moving down while the other is moving up, and vice versa. In this mode the first mass 
moves twice as far as the second. For other initial conditions, not proportional to either 
of Eqs. (iii) or (iv), the motion of the masses is a combination of these two modes. 





1712 - 1 


FIGURE 4.2.4 A two-spring, two-mass system. 


40. In this problem we outline one way to show that if ri,..., r n are all real and different, then 
e n \ ... ,e Vnt are linearly independent on — oo < t < oo. To do this, we consider the linear 
relation 

c\e nt H-b c n e rnt = 0, -oo < t < oo (i) 

and show that all the constants are zero. 

(a) Multiply Eq. (i) by e~ nt and differentiate with respect to t , thereby obtaining 


ci(r 2 - n)e^- ri) ‘ + • • • + c n (r n - = 0. 
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(b) Multiply the result of part (a) by e {r2 n)t and differentiate with respect to t to obtain 

c 3 (r 3 - r 2 )(r 3 - + • • • + c n (r n - r 2 )(r n - = 0. 

(c) Continue the procedure from parts (a) and (b), eventually obtaining 

CniXn - r n _ i) • • • (r n - ri)e irn - r *- iy * = 0. 

Hence c n = 0, and therefore, 


de nt H-h c„_ ie rn ~ lt = 0. 

(d) Repeat the preceding argument to show that c n _i = 0. In a similar way it follows that 
c n _2 = «• • = ci = 0. Thus the functions e nt ,..., e Vnt are linearly independent. 

41. In this problem we indicate one way to show that if r = r\ is a root of multiplicity 5 
of the characteristic polynomial Z(r), then e n \ te n \..., t s ~ x e rit are solutions of Eq. (1). 
This problem extends to nth order equations the method for second order equations given 
in Problem 22 of Section 3.4. We start from Eq. (2) in the text 

L[e rt ] = e rt Z (r) (i) 

and differentiate repeatedly with respect to r, setting r = r\ after each differentiation. 

(a) Observe that if r\ is a root of multiplicity s, then Z(r) = (r — ri) s q(r), where q{r) is 
a polynomial of degree n — s and q(r\) ^ 0. Show that Z(ri), Z'(ri),..., Z ( * -1) (ri) are all 
zero, but Z (s) (r\) ^ 0. 

(b) By differentiating Eq. (i) repeatedly with respect to r, show that 


^L[e n ] = L 
dr 



Lite"], 


d s-\ 

Q r s-1 


L[e n ] = L{f- l e rt l 


(c) Show that e' 1 ', te n ‘,..., t' ] e r,t are solutions of Eq. (1). 


4.3 The Method of Undetermined Coefficients 


A particular solution Y of the nonhomogeneous nth order linear equation with 
constant coefficients 

L[y] = aoy (n) + a\y {n ~ l) H-1- a n -\y' + a n y = g(t) (1) 

can be obtained by the method of undetermined coefficients, provided that g(t) is 
of an appropriate form. Although the method of undetermined coefficients is not 
as general as the method of variation of parameters described in the next section, it 
is usually much easier to use when it is applicable. 

Just as for the second order linear equation, when the constant coefficient lin¬ 
ear differential operator L is applied to a polynomial A§t m + A\t m ~ x H-+ A m , an 
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EXAMPLE 

1 


EXAMPLE 

2 


exponential function e at , a sine function sin /3t , or a cosine function cos fit, the result 
is a polynomial, an exponential function, or a linear combination of sine and cosine 
functions, respectively. Hence, if g(t) is a sum of polynomials, exponentials, sines, and 
cosines, or products of such functions, we can expect that it is possible to find Y ( t) 
by choosing a suitable combination of polynomials, exponentials, and so forth, mul¬ 
tiplied by a number of undetermined constants. The constants are then determined 
by substituting the assumed expression into Eq. (1). 

The main difference in using this method for higher order equations stems from 
the fact that roots of the characteristic polynomial equation may have multiplicity 
greater than 2. Consequently, terms proposed for the nonhomogeneous part of the 
solution may need to be multiplied by higher powers of t to make them different from 
terms in the solution of the corresponding homogeneous equation. The following 
examples illustrate this. In these examples we have omitted numerous straightfor¬ 
ward algebraic steps, because our main goal is to show how to arrive at the correct 
form for the assumed solution. 


Find the general solution of 

f'-3f + 3? -y = 4e t . (2) 

The characteristic polynomial for the homogeneous equation corresponding to Eq. (2) is 

r 3 -3r 2 + 3r —l = (r —l) 3 , 

so the general solution of the homogeneous equation is 

y c (t) = cie* + c 2 te ? + c 3 tV. (3) 

To find a particular solution Y(t) of Eq. (2), we start by assuming that Y(t) = Ae f . However, 
since te\ and t 2 e f are all solutions of the homogeneous equation, we must multiply this 
initial choice by t 3 . Thus our final assumption is that Y(t) = At 3 e f , where A is an undeter¬ 
mined coefficient. To find the correct value for A, we differentiate Y(t) three times, substitute 
for y and its derivatives in Eq. (2), and collect terms in the resulting equation. In this way we 
obtain 

6 Ae l = 4e*. 

Thus A = | and the particular solution is 

Y(t) = ftV. (4) 

The general solution of Eq. (2) is the sum of y c (t) from Eq. (3) and Y(t) from Eq. (4): 

y = c 1 e t + c 2 te t + c 3 t 2 e t + | t 3 e l . 


Find a particular solution of the equation 

y (4) + 2 y" + y — 3 sin t — 5 cos t. (5) 

The general solution of the homogeneous equation was found in Example 3 of Section 4.2; 
it is 


y c (t) = ci cos t + c 2 sin t + c 3 t cos t + c 4 t sin t. 


(6) 
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corresponding to the roots r = i, i , —and —i of the characteristic equation. Our initial assump¬ 
tion for a particular solution is Y(t) = A sin t + B cos t , but we must multiply this choice by t 2 to 
make it different from all solutions of the homogeneous equation. Thus our final assumption is 

Y(t) = At 2 sin t + Bt 2 cos t. 

Next, we differentiate Y(t) four times, substitute into the differential equation (4), and collect 
terms, obtaining finally 

—8 A sin t — SB cos t = 3 sin t — 5 cos t. 

Thus A = — |, B = |, and the particular solution of Eq. (4) is 

Y(t) = -1 1 2 sin t + |t 2 cos t. (7) 

If g(0 is a sum of several terms, it may be easier in practice to compute separately 
the particular solution corresponding to each term in g(t). As for the second order 
equation, the particular solution of the complete problem is the sum of the particular 
solutions of the individual component problems. This is illustrated in the following 
example. 


EXAMPLE 

3 


Find a particular solution of 

y'" — 4y' = t + 3 cos t + e~ 2t . (8) 

First we solve the homogeneous equation. The characteristic equation is r 3 — 4r = 0, and 
the roots are r = 0, ±2; hence 

y c (t) = ci + c 2 e 21 + c 3 e“ 2 '. 

We can write a particular solution of Eq. (8) as the sum of particular solutions of the differential 
equations 

y'" - 4 y — t, y'" — 4y' = 3 cos t , y'" — 4/ = e~ 2t . 

Our initial choice for a particular solution Y\ (t) of the first equation is A 0 t + A\ , but a constant 
is a solution of the homogeneous equation, so we multiply by t. Thus 

Y\ (t) = t(Aot + A\). 


For the second equation we choose 

y 2 (0 = 5 cos t + C sin t, 

and there is no need to modify this initial choice since sin t and cos t are not solutions of the 
homogeneous equation. Finally, for the third equation, since e~ 2t is a solution of the homo¬ 
geneous equation, we assume that 

Y 3 (t) = Ete~ 2t . 

The constants are determined by substituting into the individual differential equations; they 
are A 0 = — |, A\ = 0, B = 0, C = — |, and E=\. Hence a particular solution of Eq. (8) is 

Y(t) = -It 2 - fshu-b \te~ 2t . (9) 

You should keep in mind that the amount of algebra required to calculate 
the coefficients may be quite substantial for higher order equations, especially if the 
nonhomogeneous term is even moderately complicated. A computer algebra system 
can be extremely helpful in executing these algebraic calculations. 
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The method of undetermined coefficients can be used whenever it is possible to 
guess the correct form for Y(t). However, this is usually impossible for differential 
equations not having constant coefficients, or for nonhomogeneous terms other than 
the type described previously. For more complicated problems we can use the method 
of variation of parameters, which is discussed in the next section. 


PROBLEMS 


In each of Problems 1 through 8, determine the general solution of the given differential 
equation. 


1. y"' — y" — y' + y = 2e~ f + 3 
3. y m + y" + y + y = e + 4 1 
5. y (4) - 4 y" = t 2 + d 
7. y^+y'" = t 


2. y( 4 ) - y = 3t + COS t 

4. y"' — y' = 2 sin t 

6. y (4) + 2 y" + y = 3 + cos 2 1 

8. y (4) + y'" = sin 2 1 


In each of Problems 9 through 12, find the solution of the given initial value problem. Then 
plot a graph of the solution. 

4fl 9. /" + 4/ = t- y(0)=/(0) = 0, /'(()) = 1 

10 . y w + 2 y" + y = 3t + 4; >>( 0 ) = /( 0 ) = 0 , /'( 0 ) = /"( 0 ) = 1 

4fi 11. y"’ ~ 3 y" + 2/ = t + e‘\ y(0) = 1, /(0) = y"{ 0) = - | 

^ 12. y w + 2/" + / + 8/ - 12 y = 12 sin t-e~‘; y( 0) = 3, /(0) = 0, 

y" (0) = - 1 , y'"( 0) = 2 


In each of Problems 13 through 18, determine a suitable form for Y(t) if the method of 
undetermined coefficients is to be used. Do not evaluate the constants. 

13. y"' - 2y" + / = f 3 + 2d 14. y'" - y' = + 2 cos t 

15. y (4) — 2 y" + y = e f + sint 16. y (4) + 4y" = sin2^ + td + 4 

17. y (4) — y ;// — /' + / = F + 4 + ^ sin t 18. y (4) + 2 y"’ + 2y v = 3e r + 2te~ l + sin t 


19. Consider the nonhomogeneous nth order linear differential equation 

a 0 y (n) + a 1 y (n ~ 1) 4-f fl n y = g(0, (i) 

where ao,...,a n are constants. Verify that if g(t) is of the form 

e at (b 0 t m + --- + b m ), 

then the substitution y = e at u(t) reduces Eq. (i) to the form 

kou (n) + &iw (n-1) H-h k n u = b^t 171 4-+ 6 m , (ii) 

where ko,...,k n are constants. Determine &o an d k n in terms of the a’s and a. Thus the 
problem of determining a particular solution of the original equation is reduced to the sim¬ 
pler problem of determining a particular solution of an equation with constant coefficients 
and a polynomial for the nonhomogeneous term. 

Method of Annihilators. In Problems 20 through 22, we consider another way of arriving at 
the proper form of Y(t) for use in the method of undetermined coefficients. The procedure 
is based on the observation that exponential, polynomial, or sinusoidal terms (or sums and 
products of such terms) can be viewed as solutions of certain linear homogeneous differential 
equations with constant coefficients. It is convenient to use the symbol D for d/dt. Then, for 
example, e~ l is a solution of (.D + l)y = 0; the differential operator D + 1 is said to annihilate , 
or to be an annihilator of, e~ l . In the same way, D 2 + 4 is an annihilator of sin2£ or cos2£, 
(.D — 3) 2 = D 2 — 6 D + 9 is an annihilator of e 3t or te 3t , and so forth. 
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20. Show that linear differential operators with constant coefficients obey the commutative 
law. That is, show that 


(D - a)(D - b)f = (D — b)(D - d)f 

for any twice-differentiable function / and any constants a and b. The result extends at 
once to any finite number of factors. 

21. Consider the problem of finding the form of a particular solution Y ( t ) of 

CD - 2) 3 (D + 1 )Y = 3e 2t - te~\ (i) 

where the left side of the equation is written in a form corresponding to the factorization 
of the characteristic polynomial. 

(a) Show that D — 2 and (D + l) 2 , respectively, are annihilators of the terms on the right 
side of Eq. (i), and that the combined operator (D — 2)(D + l) 2 annihilates both terms on 
the right side of Eq. (i) simultaneously. 

(b) Apply the operator (D - 2)(D + l) 2 to Eq. (i) and use the result of Problem 20 to 
obtain 

(D-2) 4 (D + 1) 3 Y = 0. (ii) 

Thus Y is a solution of the homogeneous equation (ii). By solving Eq. (ii), show that 

Y(t) = c x e 2t + c 2 te 2t + c 3 t 2 e 2t + c A t 3 e 2t + c 5 e~ l + c 6 te + c 7 t 2 e~\ (iii) 

where c\, ..., c 7 are constants, as yet undetermined. 

(c) Observe that e 2t , te 2t , t 2 e 2t , and e~ l are solutions of the homogeneous equation cor¬ 
responding to Eq. (i); hence these terms are not useful in solving the nonhomogeneous 
equation. Therefore, choose ci, c 2 , c 3 , and c$ to be zero in Eq. (iii), so that 

Y (t) = c 4 t 3 e 2t + c 6 te _r + (iv) 

This is the form of the particular solution Y of Eq. (i). The values of the coefficients c 4 , c 6 , 
and c 7 can be found by substituting from Eq. (iv) in the differential equation (i). 

Summary. Suppose that 

L(D)y = g(t ), (v) 

where L(D) is a linear differential operator with constant coefficients, and g(t) is a sum or 
product of exponential, polynomial, or sinusoidal terms. To find the form of a particular 
solution of Eq. (v), you can proceed as follows: 

(a) Find a differential operator H(D ) with constant coefficients that annihilates g(t) —that is, 
an operator such that H(D)g(t ) = 0. 

(b) Apply H(D ) to Eq. (v), obtaining 

H(D)L(D)y = 0, (vi) 

which is a homogeneous equation of higher order. 

(c) Solve Eq. (vi). 

(d) Eliminate from the solution found in step (c) the terms that also appear in the solution 
of L(D)y = 0. The remaining terms constitute the correct form of a particular solution of 
Eq. (v). 

22. Use the method of annihilators to find the form of a particular solution Y(t) for each of 
the equations in Problems 13 through 18. Do not evaluate the coefficients. 
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The method of variation of parameters for determining a particular solution of the 
nonhomogeneous ni\v order linear differential equation 

L[y] = y (n) + Pl (t)y^- 1) + ■ ■ ■+p n -i(t)y' +p n (t)y = g(f ) (1) 

is a direct extension of the method for the second order differential equation (see 
Section 3.6). As before, to use the method of variation of parameters, it is first nec¬ 
essary to solve the corresponding homogeneous differential equation. In general, 
this may be difficult unless the coefficients are constants. However, the method of 
variation of parameters is still more general than the method of undetermined coef¬ 
ficients in that it leads to an expression for the particular solution for any continuous 
function g, whereas the method of undetermined coefficients is restricted in practice 
to a limited class of functions g. 

Suppose then that we know a fundamental set of solutions yi, y 2 , ... ,y n of the 
homogeneous equation. Then the general solution of the homogeneous equation is 

y c (t) = ciyiit) + c 2 y 2 {t) +-b c n y n (t). (2) 

The method of variation of parameters for determining a particular solution of Eq. (1) 
rests on the possibility of determining n functions u\, u 2 ,...,u n such that Y(t) is of 
the form 

Y (t) = Ui (f )yi (0 + U 2 ( t)y 2 (t) +- Yu n (i t)y n (t) . (3) 

Since we have n functions to determine, we will have to specify n conditions. One 
of these is clearly that Y satisfy Eq. (1). The other n — 1 conditions are chosen so 
as to make the calculations as simple as possible. Since we can hardly expect a sim¬ 
plification in determining Y if we must solve high order differential equations for 
Mi, ..., u n , it is natural to impose conditions to suppress the terms that lead to higher 
derivatives of mi, ..., u n . From Eq. (3) we obtain 

Y = (U\y[ + U 2 y' 2 + • • • + u ny ' n ) + ( u [H + u 2 y 2 + ’ ’ ’ + u ' n yn)i (4) 

where we have omitted the independent variable t on which each function in Eq. (4) 
depends. Thus the first condition that we impose is that 

u[yi + u' 2 y 2 H-b u' n y n = 0. (5) 

It follows that the expression (4) for Y' reduces to 

Y' = u x y’ x + u 2 y' 2 + • • • + u n y' n . (6) 

We continue this process by calculating the successive derivatives Y ",..., 

After each differentiation we set equal to zero the sum of terms involving derivatives 
of mi, ..., u n . In this way we obtain n — 2 further conditions similar to Eq. (5); that is, 

Miyf 0 + M 2 ) 4 m) H-b M^ m) =0, m = 1,2,..., n - 2. (7) 

As a result of these conditions, it follows that the expressions for Y",..., Y (w-1) 
reduce to 


Y^= u yy + u 2 yf ) + ---+u n yv 


(m) 


m = 2 , 3 ,... ,n — 1 , 


( 8 ) 
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Finally, we need to impose the condition that Y must be a solution of Eq. (1). By 
differentiating from Eq. (8), we obtain 

y (n) = + • • • + u n y < n) ) + _1) + • • • + <3'i"“ 1) )- (9) 

To satisfy the differential equation we substitute for Y and its derivatives in Eq. (1) 
from Eqs. (3), (6), (8), and (9). Then we group the terms involving each of the 
functions yi,...,y n and their derivatives. It then follows that most of the terms in the 
equation drop out because each of yi,... ,y n is a solution of Eq. (1) and therefore 
L[y t ] = 0, i = 1,2,..., n. The remaining terms yield the relation 

+ tyt 1 '+■■■+=§ • (io) 

Equation (10), Eq. (5), and the n — 2 equations (7) provide n simultaneous linear 
nonhomogeneous algebraic equations for u' v u ' 2 ,..., u' n : 

yiu[ +y 2 u' 2 H- \~ynU' n = 0, 

y'l u l + y f 2 u 2 d-b y'n u n = 

y'l u l + y f 2 u 2 -b y'n U 'n = (11) 


(n-1) / . 

yl Mi + ■ 


■+yr i) <=g. 


The system (11) is a linear algebraic system for the unknown quantities u [,..., u' n . 
By solving this system and then integrating the resulting expressions, you can obtain 
the coefficients ui ,..., u n . A sufficient condition for the existence of a solution of the 
system of equations (11) is that the determinant of coefficients is nonzero for each 
value oft. However, the determinant of coefficients is precisely W{yi,y 2 ,... ,y n ), and 
it is nowhere zero since yi,... ,y n is a fundamental set of solutions of the homoge¬ 
neous equation. Hence it is possible to determine u' v ... ,u' n . Using Cramer’s 3 rule, 
we can write the solution of the system of equations (11) in the form 


* 4(0 


g(t)W m (t) 

W(t) 


m = 1,2 ,... ,n. 


( 12 ) 


Here W(t) = W(yi,y 2 , ... ,y n )( 0, and W m is the determinant obtained from W by 
replacing the rath column by the column (0,0,..., 0,1). With this notation a particular 
solution of Eq. (1) is given by 


n r>t 

Y(t) = / 

m =1 to 


g(s)W m (s) 

W(s) 


ds, 


(13) 


where to is arbitrary. Although the procedure is straightforward, the algebraic com¬ 
putations involved in determining Y(0 from Eq. (13) become more and more 


3 Cramer’s rule is credited to the Swiss mathematician Gabriel Cramer (1704-1752), professor at the 
Academie de Calvin in Geneva, who published it in a general form (but without proof) in 1750. For small 
systems the result had been known earlier. 
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EXAMPLE 

1 


complicated as n increases. In some cases the calculations may be simplified to some 
extent by using Abel’s identity (Problem 20 of Section 4.1), 

W(t) = W(yi ,... ,y n )(t) = c exp 

The constant c can be determined by evaluating W at some convenient point. 


/ 


- / pi(t) dt 


Given that y\{t) = e t ,y 2 (t) = te*, and y 3 (t) = e f are solutions of the homogeneous equation 
corresponding to 

y"'-y"-y' + y = g(t), (14) 

determine a particular solution of Eq. (14) in terms of an integral. 

We use Eq. (13). First, we have 


W(t) = W(e f ,te f ,e r )(0 = 


Factoring e l from each of the first two columns and 


te l e 1 

(t + l)e l —e~ l . 
it + 2 Y e~ l 

e~ l from the third column, we obtain 


W{t) = e 1 


1 

1 

1 


t 1 
t + 1 -1 

t + 2 1 


Then, by subtracting the first row from the second and third rows, we have 


W(t) = e f 


1 

0 

0 


t 1 

1 -2 

2 0 


Finally, evaluating the latter determinant by minors associated with the first column, we find 
that 

Wit) = 4e*. 


Next, 


Writ) = 


0 

0 

1 


te l e 1 

it +1 y -c- r 
it + iy e~ l 


Using minors associated with the first column, we obtain 


In a similar way, 


Writ) = 


te l 

it +1 y 



-It -1 . 



W 2 it) = 
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and 


W 3 (t) = 


e‘ te‘ 0 
e‘ (t + \)e‘ 0 
e‘ (t + 2 )e‘ 1 



e‘ te‘ 


e‘ (t + l)e‘ 


Substituting these results in Eq. (13), we have 
g(s)(-l - 2s) 


Y(t) = 


J tf) 


4e s 


■ ds + te' 


I 

J to 


g(s)( 2) 
4e s 


ds + e 


= e 


-f 

J to 


g(s)e 2 

4e s 


ds 


= \ f { e * *[-1 + 2 (t-s)] + e (t S) }g(s)ds. 

4 Jto 


(15) 


Depending on the specific function g(t), it may or may not be possible to evaluate the integrals 
in Eq. (15) in terms of elementary functions. 


PROBLEMS In each of Problems 1 through 6, use the method of variation of parameters to determine the 
general solution of the given differential equation. 

1. y"' + y = tan t, — jt/2 < t < jt/2 2. y'" — y' = t 

3. y'" — 2y" -y'-\-2y = e 4t 4. y m + / = sec t , —it/2 <t< n/2 

5. y'" — y" + y' — y — e~ l sin t 6. y (4) + 2 y" + y = sin t 


In each of Problems 7 and 8, find the general solution of the given differential equation. Leave 
your answer in terms of one or more integrals. 

7. y'" — y" + / - y = sec t, —tt/ 2 < t < jt/2 

8. y'" — y' — esc t, 0 < t < n 

In each of Problems 9 through 12, find the solution of the given initial value problem. Then 
plot a graph of the solution. 

9. y'" +/ = sect; y(0) = 2, /(O) = 1, y"(0) = -2 

jfl, 10. y (4) + 2 y" + y = sint; y(0) = 2, /(0) = 0, y"(0) = -1, y'"(0) = 1 

11. y /;/ -/'+/- y = sec t\ y(0) = 2, /(0) = -1, /'(0) = 1 

12. y /;/ —y' = esc t; y(;r/2) = 2, /(tt/2) = 1, y"(n/ 2 ) = —1 

13. Given that x,x 2 , and 1/x are solutions of the homogeneous equation corresponding to 


x 3 /" + x 2 / - 2x/ + 2y = 2x 4 , x > 0, 


determine a particular solution. 

14. Find a formula involving integrals for a particular solution of the differential equation 


15. Find a formula involving integrals for a particular solution of the differential equation 

y i4) -y = g(t). 

Hint: The functions sin t, cos t , sinh t , and cosh t form a fundamental set of solutions of 
the homogeneous equation. 
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16. Find a formula involving integrals for a particular solution of the differential equation 

y'" - 3y" + 3y' —y = g(t). 

Ifg(0 = rV, determine Y(t). 

17. Find a formula involving integrals for a particular solution of the differential equation 

x 3 y m - 3 x 2 y" + 6 xy' — 6y = g(x), x > 0. 

Hint: Verify that x,x 2 , and x 3 are solutions of the homogeneous equation. 


Coddington, E. A., An Introduction to Ordinary Differential Equations (Englewood Cliffs, NJ: Prentice- 
Hall, 1961; New York: Dover, 1989). 

Coddington, E. A. and Carlson, R., Linear Ordinary Differential Equations (Philadelphia, PA: Society for 
Industrial and Applied Mathematics, 1997). 





CHAPTER 


Series Solutions of 
Second Order 
Linear Equations 


Finding the general solution of a linear differential equation depends on determin¬ 
ing a fundamental set of solutions of the homogeneous equation. So far, we have given 
a systematic procedure for constructing fundamental solutions only if the equation 
has constant coefficients. To deal with the much larger class of equations that have 
variable coefficients, it is necessary to extend our search for solutions beyond the 
familiar elementary functions of calculus. The principal tool that we need is the rep¬ 
resentation of a given function by a power series. The basic idea is similar to that in 
the method of undetermined coefficients: we assume that the solutions of a given dif¬ 
ferential equation have power series expansions, and then we attempt to determine 
the coefficients so as to satisfy the differential equation. 


5.1 Review of Power Series 


In this chapter we discuss the use of power series to construct fundamental sets of 
solutions of second order linear differential equations whose coefficients are func¬ 
tions of the independent variable. We begin by summarizing very briefly the pertinent 
results about power series that we need. Readers who are familiar with power series 
may go on to Section 5.2. Those who need more details than are presented here 
should consult a book on calculus. 

oo 

1. A power series J2 a n (x — x o) n is said to converge at a point x if 

n =0 

m 

lim ; a n {x — xo) n 

m^-oo ' 
n =0 
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exists for that x. The series certainly converges for x = x 0 ; it may converge for all x, or it 
may converge for some values of x and not for others. 

oo 

2. The series J2 a n( x ~ x o) n is said to converge absolutely at a point x if the series 

n =0 


oo 


oo 


^ 2 \a n (x - x 0 ) n \ = y>„||x-x 0 f 

n =0 n =0 


converges. It can be shown that if the series converges absolutely, then the series 
also converges; however, the converse is not necessarily true. 

3. One of the most useful tests for the absolute convergence of a power series is the ratio 
test. If a n ^ 0, and if, for a fixed value of x, 


lim 

a n +i(x 

-X 0 ) n+1 

= |x — Xo | lim 

M-n+l 

n-> oo 

a n (x 

-xo r 

n—>oo 

tt n 


|x — x o\L, 


then the power series converges absolutely at that value of x if |x — x 0 |L < 1 and diverges 
if |x — xo|L > 1. If |x — xq|L = 1, the test is inconclusive. 


For which values of x does the power series 

EXAMPLE 

1 oo 

1 J2 (- 1 )" +1 «(* - 2 )" 

n =1 


converge? 

To test for convergence, we use the ratio test. We have 


lim 

n—>oo 


(—l) n+2 {n + l)(x — 2 ) n+l 
(—1 ) n+ 1 n(x — 2 ) n 


= \x — 2 \ lim 

n—>oo 


n + 1 
n 


|x — 2|. 


According to statement 3, the series converges absolutely for |x — 2| < 1, or 1 < x < 3, and 
diverges for |x — 2| > 1. The values of x corresponding to |x — 2| = 1 are x = 1 and x = 3. The 
series diverges for each of these values of x since the nth term of the series does not approach 
zero as n -> oo. 


oo 

4 . If the power series J2 a n ( x — x o) n converges at x = xi, it converges absolutely for 

n =0 

|x — xo| < |xi — xo|; and if it diverges at x = xi, it diverges for |x — xo| > |xi — xo|. 

5. For a typical power series, such as the one in Example 1, there is a positive number p, called 

oo 

the radius of convergence, such that J2 a n ( x — x o) n converges absolutely for |x — x 0 | < p 

n =0 

and diverges for |x — xo | > p. The interval |x — xo | < p is called the interval of convergence; 
it is indicated by the hatched lines in Figure 5.1.1. The series may either converge or diverge 
when |x — x 0 1 = p. Many important power series converge for all values of x. In this case 
it is customary to say that p is infinite and the interval of convergence is the entire real 
line. It is also possible for a power series to converge only at x 0 . For such a series we say 
that p = 0 and the series has no interval of convergence. When these exceptional cases are 
taken into account, every power series has a nonnegative radius of convergence p, and if 
p > 0, then there is a (finite or infinite) interval of convergence centered at x 0 . 
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Series 

diverges 


x 0 -p 


Series 

converges 

absolutely 


-H— 

+/////I— 

Xq + p 


_ Series 
diverges 


x 


FIGURE 5.1.1 


\ Series may / 
converge or diverge 


The interval of convergence of a power series. 


EXAMPLE 

2 


Determine the radius of convergence of the power series 


y, (X+1T 
*-• n2 n 

n =1 


We apply the ratio test: 


lim 

n—>oo 


{x + l) n+1 n2 n 
(;n + l)2 n+1 (x + l) n 


\x + l\ .. n \x +1| 
—-— lim -- = —-— 

2 n^oo n + 1 2 


Thus the series converges absolutely for |x + l|<2, or —3 < x < 1, and diverges for 
|x +11 >2. The radius of convergence of the power series is p = 2. Finally, we check the 
endpoints of the interval of convergence. At x = 1 the series becomes the harmonic series 


oo ^ 


which diverges. At x = — 3 we have 

(-3 + 1 r _ (- 1 )” 

— n2 n “ n 

n =1 n=l 

which converges but does not converge absolutely. The series is said to converge condition¬ 
ally at x = —3. To summarize, the given power series converges for — 3 < x < 1 and diverges 
otherwise. It converges absolutely for — 3 < x < 1 and has a radius of convergence 2. 


oo oo 

Suppose that J2 a n( x — x o) n an d ~ x o) n converge to f(x) and g(x ), respec- 

n =0 n —0 

tively, for \x — xol < p, p > 0. 

6 . The two series can be added or subtracted termwise, and 


fix) ± g(x) = J2(a n ± b n )(x - xof; 

n =0 


the resulting series converges at least for |x — xo | < p. 

7. The two series can be formally multiplied, and 

oo 

= -x o) n . 

n =0 


f(x)g(x) = 


'Y^a n (x-x o) n 


_n=0 


'Y^ l b n (x - x 0 ) n 


_n =0 


where c n — a§b n + a\b n -\ H-b a n bo. The resulting series converges at least for 

|x - Xol < p. 
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Further, if g(x o) / 0, the series for /(x) can be formally divided by the series for g(x), and 


fix) 

g(x) 


^dniX-X o)". 
n =0 


In most cases the coefficients d n can be most easily obtained by equating coefficients in 
the equivalent relation 


oo 

^2a n (x-x 0 ) n 

n =0 


^Td n (x-x 0 ) n 


^Tb„(x-x 0 ) n 


oo / n 


E ( E dkb n -k ) (x - X 0 ) n . 


In the case of division, the radius of convergence of the resulting power series may be less 
than p. 

8 . The function / is continuous and has derivatives of all orders for \x — x 0 \ < p. Moreover, 
... can be computed by differentiating the series termwise; that is, 

f'(x) = a\ + 2 a 2 (x — x 0 ) H-+ na n (x — x 0 ) n_1 + • • • 

oo 

= ^ na n (x — jco ) 1 * -1 , 

n =1 

f"(x) = 2d2 + 6^3 (x — xo) + • • • + n(n — 1 )a n (x — xo) n ~ 2 H- 

oo 

= ^2 n ( n — l) a n(x — Xo) n ~ 2 , 

n=2 


9. 


and so forth, and each of the series converges absolutely for \x — xo \ < p. 
The value of a n is given by 

f in) (x 0 ) 


The series is called the Taylor 1 series for the function / about x = xq. 


OO OO 

10. If J2 a n( x — x o) n = J2 b n ( x ~ x o) n for each x in some open interval with center x 0 , 

n =0 n =0 


oo 

a n = b n for n = 0,1,2,3, _In particular, if J2 a n( x ~ x o) n = 0 for each such x, 

n =0 


CIq = d\ —■■■ — Cl n — ■■■ — 0 . 

A function / that has a Taylor series expansion about x = xq 


then 

then 




n =0 


n\ 


1 Brook Taylor (1685-1731), English mathematician, received his education at Cambridge University. His 
book Methodus incrementorum directa et inversa , published in 1715, includes a general statement of the 

expansion theorem that is named for him. This is a basic result in all branches of analysis, but its fundamental 
importance was not recognized until 1772 (by Lagrange). Taylor was also the first to use integration by 
parts, was one of the founders of the calculus of finite differences, and was the first to recognize the 
existence of singular solutions of differential equations. 
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with a radius of convergence p > 0, is said to be analytic at % = xo. All of the familiar 
functions of calculus are analytic except perhaps at certain easily recognized points. 
For example, sinx and e x are analytic everywhere, 1 /x is analytic except at x = 0, and 
tanx is analytic except at odd multiples of 7r/2. According to statements 6 and 7, if/ 
and g are analytic at xo, then / d= g, / • g, and f/g [provided that g(xo) ^ 0] are also 
analytic at x = xo. In many respects the natural context for the use of power series 
is the complex plane. The methods and results of this chapter nearly always can be 
directly extended to differential equations in which the independent and dependent 
variables are complex-valued. 


Shift of Index of Summation. The index of summation in an infinite series is a dummy 
parameter just as the integration variable in a definite integral is a dummy variable. 
Thus it is immaterial which letter is used for the index of summation. For example, 


oo 


E 

n =0 


2 n x n 

n\ 


oo 


E 


2 7 x 7 

T' 


Just as we make changes of the variable of integration in a definite integral, we find 
it convenient to make changes of summation indices in calculating series solutions of 
differential equations. We illustrate by several examples how to shift the summation 
index. 


EXAMPLE 

3 


oo 

Write J2 a nX n as a series whose first term corresponds to n = 0 rather than n = 2. 

n =2 

Let m = n — 2; then n = m + 2, and n = 2 corresponds to m = 0. Hence 

oo oo 

J2a n x n = J2 a ^ xm+2 - (!) 

n=2 m =0 

By writing out the first few terms of each of these series, you can verify that they contain 
precisely the same terms. Finally, in the series on the right side of Eq. (1), we can replace the 
dummy index mby n, obtaining 

oo oo 

L a »X n = L a n+2X n+2 ■ (2) 

n =2 n =0 

In effect, we have shifted the index upward by 2 and have compensated by starting to count 
at a level 2 lower than originally. 


EXAMPLE 

4 


Write the series 

oo 

y^{n + 2)(n + \)a n {x - x 0 ) n ~ 2 (3) 

n=2 

as a series whose generic term involves (x — x 0 ) n rather than (x — x 0 ) n_2 . 

Again, we shift the index by 2 so that n is replaced by n + 2 and start counting 2 lower. We 
obtain 

oo 

L(« + 4 )(« + 3)<W2(*-*o)"- (4) 

n =0 

You can readily verify that the terms in the series (3) and (4) are exactly the same. 
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EXAMPLE 

5 


EXAMPLE 

6 


Write the expression 

oo 

x 2 ( r + ri)a n x rJrn - x (5) 

n =0 

as a series whose generic term involves x r+n . 

First, take the x 2 inside the summation, obtaining 

oo 

J 2 (r + n)a n x r+n+1 . (6) 

n =0 

Next, shift the index down by 1 and start counting 1 higher. Thus 


J2 ( r + n)a n x r+n+1 = ^2 ( r + n ~ ^)d n -ix r+n . (7) 

n =0 n =1 

Again, you can easily verify that the two series in Eq. (7) are identical and that both are exactly 
the same as the expression (5). 


Assume that 

oo oo 

Y na n x n ~ l = Yj a nX n (8) 

n =1 n =0 

for all x, and determine what this implies about the coefficients a n . 

We want to use statement 10 to equate corresponding coefficients in the two series. In order 
to do this, we must first rewrite Eq. (8) so that the series display the same power of x in their 
generic terms. For instance, in the series on the left side of Eq. (8), we can replace n by n + 1 
and start counting 1 lower. Thus Eq. (8) becomes 

oo oo 

T> + l)a n+1 x n = ^2 a n x". (9) 

n =0 n =0 

According to statement 10, we conclude that 

(n + l)a n+ i = a n , n = 0 , 1,2,3,... 
or 

a n + ' = 7+ 1’ n = 0,1,2,3,.... (10) 

Hence, choosing successive values of n in Eq. (10), we have 

Cl\ CIq Cl2 do 

Cl\ = ClQ, do = — = —, d^ = — = —, 

1 u, 2 2 3 3! 

and so forth. In general, 

a n = —, n = 1,2,3,.... (11) 

n\ 

Thus the relation (8) determines all the following coefficients in terms of oq. Finally, using the 
coefficients given by Eq. (11), we obtain 

oo oo n 

Y d n X n = do Y — — a 0^, 

^ ^ n\ 

n =0 n =0 


where we have followed the usual convention that 0! = 1. 
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PROBLEMS 


In each of Problems 1 through 8, determine the radius of convergence of the given power 
series. 


1. £(x-3)" 

n =0 
oo y2n 

3 - £ -T 
n =o n\ 

«° (2x + l)" 

■ «=1 « 2 

„ ~ (-l) n n 2 (x + 2y 

' h 3« 


2 - £ ^ x " 
to 2" 


4. 


£ 2 n x n 


n =0 


6 . 


™ (X - xp)” 
n=l n 


8 . 


oo 


£ 

n=l 


n\x n 

n n 


In each of Problems 9 through 16, determine the Taylor series about the point x 0 for the given 
function. Also determine the radius of convergence of the series. 


9. sinx, x 0 — 0 
11. x, x 0 — 1 

13. lnx, xo = 1 
1 


15 


1 — x 


x 0 — 0 


10. e*, 

12. x 2 , 


14. 

16. 


1 


1 +x 
1 

1 — x’ 


x 0 — 0 

X 0 = -1 

x 0 — 0 
x 0 — 2 


17. Given that y = /rx n , compute y' and y" and write out the first four terms of each series, 

n =0 

as well as the coefficient of x n in the general term. 


oo 

18. Given that y = J2 a nX n , compute y' and y" and write out the first four terms of each 

n =0 

series, as well as the coefficient of x n in the general term. Show that if y" — y, then the 
coefficients a 0 and a\ are arbitrary, and determine a 2 and a 3 in terms of a 0 and a\. Show 
that a n+ 2 = a n /(n + 2 )(n + 1), n = 0,1,2,3,_ 


In each of Problems 19 and 20, verify the given equation. 

oo oo 

19. £ a„ (x - 1) M+1 = «„_i(x - 1)" 

n =0 n =1 

oo oo oo 

20. £ a k+ 1 x k + £ a k x k+1 = a\ + £ (a k+1 + a k ^)x k 

k =0 k =0 k =1 

In each of Problems 21 through 27, rewrite the given expression as a sum whose generic term 
involves x n . 


21. J 2 n (n — 1 )a n x n 2 

n=2 

oo oo 

23. x J2 na n x n ~ l + J2 a k xk 

n =1 fc=0 

oo oo 

25. J2 m(m — 1 )a m x m ~ 2 +xJ2 ^a^x k 

m=2 k =1 


27. xJ2 n (n — l)a n x n 2 + J2 a nX n 

n=2 n =0 


oo 

22 . UnX n+2 
n =0 

oo 

24. (1 — x 2 ) n (n — 1 )a n x n ~ 2 

n=2 

oo oo 

26. J2 nClnX”- 1 + X J2 a nX n 

n =1 n =0 
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28. Determine the a n so that the equation 

oo oo 

na n x n ~ x + 2 a n x n = 0 

n =1 n =0 


oo 

is satisfied. Try to identify the function represented by the series J2 a n x n . 

n =0 


5.2 Series Solutions Near an Ordinary Point, Part I 


In Chapter 3 we described methods of solving second order linear differential equa¬ 
tions with constant coefficients. We now consider methods of solving second order 
linear equations when the coefficients are functions of the independent variable. In 
this chapter we will denote the independent variable by %. It is sufficient to consider 
the homogeneous equation 

P{X) 0 + Q{x) % + R(x)y = O' C 1 ) 

since the procedure for the corresponding nonhomogeneous equation is similar. 

Many problems in mathematical physics lead to equations of the form (1) having 
polynomial coefficients; examples include the Bessel equation 

x 2 y" + xy' + (x 2 - v 2 )y = 0, 
where v is a constant, and the Legendre equation 

(1 - x 2 )y" - 2xy' + a(a + 1 )y = 0, 

where a is a constant. For this reason, as well as to simplify the algebraic computations, 
we primarily consider the case in which the functions P, Q , and R are polynomials. 
However, as we will see, the method of solution is also applicable when P, Q , and R 
are general analytic functions. 

For the present, then, suppose that P, Q , and R are polynomials and that there is 
no factor (x — c) that is common to all three of them. If there is such a factor (x — c), 
then divide it out before proceeding. Suppose also that we wish to solve Eq. (1) in 
the neighborhood of a point jco. The solution of Eq. (1) in an interval containing %o 
is closely associated with the behavior of P in that interval. 

A point xo such that P(x o) ^ 0 is called an ordinary point. Since P is continuous, it 
follows that there is an interval about xo in which P{x) is never zero. In that interval 
we can divide Eq. (1) by P(x) to obtain 

y" + p(x)y' + q(x)y = 0, (2) 

where p(x) = Q(x)/P{x) and q(x) = R(x)/P(x) are continuous functions. Hence, 
according to the existence and uniqueness Theorem 3.2.1, there exists in that inter¬ 
val a unique solution of Eq. (1) that also satisfies the initial conditions y(x o) = yo , 
y'(xo) = >>o for arbitrary values of yo and y r Q . In this and the following section, we 
discuss the solution of Eq. (1) in the neighborhood of an ordinary point. 

On the other hand, if P(%o) = 0, then xo is called a singular point of Eq. (1). In 
this case at least one of Q(x o) and R(xq) is not zero. Consequently, at least one of 





5.2 Series Solutions Near an Ordinary Point, Part I 


255 


the coefficients p and q in Eq. (2) becomes unbounded as x -> jcq, and therefore 
Theorem 3.2.1 does not apply in this case. Sections 5.4 through 5.7 deal with finding 
solutions of Eq. (1) in the neighborhood of a singular point. 

We now take up the problem of solving Eq. (1) in the neighborhood of an ordinary 
point jco. We look for solutions of the form 

oo 

y = ao + a\(x — xo) H- b a n (x - xq) h H-= E a n (x - xo) n (3) 

n —0 

and assume that the series converges in the interval \x — xo\ < p for some p > 0. 
While at first sight it may appear unattractive to seek a solution in the form of a 
power series, this is actually a convenient and useful form for a solution. Within their 
intervals of convergence, power series behave very much like polynomials and are 
easy to manipulate both analytically and numerically. Indeed, even if we can obtain 
a solution in terms of elementary functions, such as exponential or trigonometric 
functions, we are likely to need a power series or some equivalent expression if we 
want to evaluate them numerically or to plot their graphs. 

The most practical way to determine the coefficients a n is to substitute the series 
(3) and its derivatives for y,y', andy" in Eq. (1). The following examples illustrate this 
process. The operations, such as differentiation, that are involved in the procedure 
are justified so long as we stay within the interval of convergence. The differential 
equations in these examples are also of considerable importance in their own right. 


EXAMPLE 

1 


Find a series solution of the equation 


y" + y = 0, -oo < x < oo. (4) 

As we know, sinx and cosx form a fundamental set of solutions of this equation, so 
series methods are not needed to solve it. However, this example illustrates the use of 
power series in a relatively simple case. For Eq. (4), P{x) = 1, Q(x) = 0, and R(x) = 1; hence 
every point is an ordinary point. 

We look for a solution in the form of a power series about x 0 = 0 

oo 

y = ao + a\x + a 2 X 2 + • • • + a n x n H-= ^ a n x n (5) 

n =0 

and assume that the series converges in some interval |x| < p. Differentiating Eq. (5) term by 
term, we obtain 

oo 

y' = a\ + 2 a 2 X + • • • + na n x n ~ l H-= ^ na n x n ~ l (6) 

n =1 


and 

oo 

y" = 2a 2 + • • • + n(n — 1 )a n x n ~ 2 H-= ^ n(n — 1 )a n x n ~ 2 . 

n=2 

Substituting the series (5) and (7) for y and y" in Eq. (4) gives 


n(n — 1 )a n x n 2 + ^ a n x n = 0. 


n=2 


n =0 


( 7 ) 
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To combine the two series, we need to rewrite at least one of them so that both series display 
the same generic term. Thus, in the first sum, we shift the index of summation by replacing n 
by n + 2 and starting the sum at 0 rather than 2. We obtain 

oo oo 

Y i n + 2 )i n + l)a n +2X n + Y anXn = 0 

n =0 n =0 


or 

oo 

Y [in + 2)(n + l)a n+2 + a n ]x n = 0. 

n =0 


For this equation to be satisfied for all x, the coefficient of each power of x must be zero; hence 
we conclude that 

(n + 2)(n + l)a n+2 + a n = 0, n = 0,1,2, 3 ,_ (8) 

Equation (8) is referred to as a recurrence relation. The successive coefficients can be 
evaluated one by one by writing the recurrence relation first for n = 0, then for n — 1, and 
so forth. In this example Eq. (8) relates each coefficient to the second one before it. Thus 
the even-numbered coefficients (oq, ^2,^4, • • •) and the odd-numbered ones (01,^3,05,...) are 
determined separately. For the even-numbered coefficients we have 

CIq CIq 0,2 Oq O4 Oq 

tt2 = ~2^1 = ~ 2!’ a4 = ~ 4 ^ 3 =+ 4 !’ a6 = _ 6^5 = “ 6\’' " ' 

These results suggest that in general, if n = 2 k , then 

(- 1 )* 

a n = a 2 k= ( 2 k)\ a °’ k = 1 , 2 , 3 ,.... ( 9 ) 

We can prove Eq. ( 9 ) by mathematical induction. First, observe that it is true for k = 1 . Next, 
assume that it is true for an arbitrary value of k and consider the case k + 1 . We have 

02k _ (-l)^ _ (-1)* +1 

° 2k+2 (2k + 2)(2k + 1) (2k + 2)(2k + l)(2ky a ° (2k + 2)1°°' 

Hence Eq. ( 9 ) is also true for k + 1 , and consequently it is true for all positive integers k. 
Similarly, for the odd-numbered coefficients 


a 3 = - 


0\ 

2^3 


0\ 

3!’ 


a 5 = - 


0 3 0\ 
5^4 = + 5!~’ 


«7 = - 


Os 

7^6 


0\ 

7!’"*’ 


and in general, if n = 2k + 1, then 2 


= a2k+i = 


(-D* 

(2k + iy. au 


k = 1,2,3,.... 


Substituting these coefficients into Eq. (5), we have 


( 10 ) 


2 The result given in Eq. (10) and other similar formulas in this chapter can be proved by an induction 
argument resembling the one just given for Eq. (9). We assume that the results are plausible and omit the 
inductive argument hereafter. 
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(-l) n ao x2n (-1 ) n ai 

(2 n)\ (2n + l)! 


-x 2n+1 H- 



nr 

(2n)! 





( 11 ) 


Now that we have formally obtained two series solutions of Eq. (4), we can test them for 
convergence. Using the ratio test, we can show that each of the series in Eq. (11) converges 
for all x, and this justifies retroactively all the steps used in obtaining the solutions. Indeed, 
we recognize that the first series in Eq. (11) is exactly the Taylor series for cosx about x = 0 
and that the second is the Taylor series for sin x about x — 0. Thus, as expected, we obtain the 
solution y = a 0 cosx + a\ sinx. 

Notice that no conditions are imposed on a 0 and a\, hence they are arbitrary. From Eqs. (5) 
and (6) we see that y and y' evaluated at x = 0 are ao and a \, respectively. Since the initial 
conditions y(0) and /(0) can be chosen arbitrarily, it follows that a 0 and a\ should be arbitrary 
until specific initial conditions are stated. 

Figures 5.2.1 and 5.2.2 show how the partial sums of the series in Eq. (11) approximate 
cos x and sinx. As the number of terms increases, the interval over which the approximation is 
satisfactory becomes longer, and for each x in this interval the accuracy of the approximation 
improves. However, you should always remember that a truncated power series provides only 
a local approximation of the solution in a neighborhood of the initial point x = 0; it cannot 
adequately represent the solution for large |x|. 


y 

2 


n = 4 72 = 8 n- 12 n- 16 n- 20 


1 



2 


4 


6 


8 


10 % 


-1 



y - cos x 


-2 


71 = 2 71 = 6 71 = 10 71 = 14 71 = 18 


FIGURE 5.2.1 Polynomial approximations to cosx. The value 
of n is the degree of the approximating polynomial. 
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FIGURE 5.2.2 Polynomial approximations to sinx. The value 
of n is the degree of the approximating polynomial. 


In Example 1 we knew from the start that sin x and cos x form a fundamental set of 
solutions of Eq. (4). However, if we had not known this and had simply solved Eq. (4) 
using series methods, we would still have obtained the solution (11). In recognition 
of the fact that the differential equation (4) often occurs in applications, we might 
decide to give the two solutions of Eq. (11) special names, perhaps 


C(x) 




n =0 


( 2 / 0 ! 


Six) = J2 


n =0 


nr 

(2#i + l)f 


2w+l 


( 12 ) 


Then we might ask what properties these functions have. For instance, can we be sure 
that C(x) and S(x) form a fundamental set of solutions? It follows at once from the 
series expansions that C(0) = 1 and *5(0) = 0. By differentiating the series for C(x) 
and S(x) term by term, we find that 


S'(x) = C(x), C'(x) = —S(x). 


(13) 


Thus, at x = 0 we have .S"(()) = 1 and (7(0) = 0. Consequently, the Wronskian of C 
and S at x = 0 is 


W(C,S)(0) 


1 0 
0 1 


= 1 , 


(14) 


so these functions do indeed form a fundamental set of solutions. By substituting —x 
for x in each of Eqs. (12), we obtain C(—x) = C(x) and S(— x) = —S(x). Moreover, 
by calculating with the infinite series, 3 we can show that the functions C(x) and S(x) 
have all the usual analytical and algebraic properties of the cosine and sine functions, 
respectively. 


3 Such an analysis is given in Section 24 of K. Knopp, Theory and Applications of Infinite Series (New York: 
Hafner, 1951). 
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Although you probably first saw the sine and cosine functions defined in a more 
elementary manner in terms of right triangles, it is interesting that these functions 
can be defined as solutions of a certain simple second order linear differential equa¬ 
tion. To be precise, the function sin* can be defined as the unique solution of the 
initial value problem y" + y = 0, y(0) = 0, /(0) = 1; similarly, cosx can be defined 
as the unique solution of the initial value problem y" + y = 0, y(0) = 1, /(0) = 0. 
Many other functions that are important in mathematical physics are also defined 
as solutions of certain initial value problems. For most of these functions there is no 
simpler or more elementary way to approach them. 


EXAMPLE 

2 


Find a series solution in powers of x of Airy’s 4 equation 

y" — xy = 0, —oo < x < oo. (15) 

For this equation P{x) = 1 ,Q{x) = 0,andi?(x) = —x; hence every point is an ordinary point. 
We assume that 

oo 

y = y^a n x n (16) 

n =0 

and that the series converges in some interval |x| < p. The series for y" is given by Eq. (7); as 
explained in the preceding example, we can rewrite it as 

oo 

y" = ^2(n + 2)(n + 1 )a n+2 x n . (17) 

n =0 

Substituting the series (16) and (17) for y and y" in Eq. (15), we obtain 

oo oo oo 

( n + 2){n + l)a n+2 x n = x ^ a n x n = ^ a n x n+1 . (18) 

n =0 n =0 n =0 

Next, we shift the index of summation in the series on the right side of Eq. (18) by replacing 
n by n — 1 and starting the summation at 1 rather than zero. Thus we have 

oo oo 

2 • la 2 + J^(« + 2)(n + l)a n+2 x n = ^ a n -\x n . 

n =1 n =1 

Again, for this equation to be satisfied for all x in some interval, the coefficients of like powers 
of x must be equal; hence a 2 = 0, and we obtain the recurrence relation 

(n + 2)(n + l)a n+2 = a n -\ for n — 1,2,3,_ (19) 


Since a n+2 is given in terms of a n _ i, the a’ s are determined in steps of three. Thus ao determines 
a 3 , which in turn determines determines a 4 , which in turn determines a 7 , ...; and a 2 

determines as, which in turn determines a 8 , .... Since a 2 = 0, we immediately conclude that 
as = a 8 = a n = • • • = 0. 


4 Sir George Biddell Airy (1801-1892), an English astronomer and mathematician, was director of the 
Greenwich Observatory from 1835 to 1881. He studied the equation named for him in an 1838 paper on 
optics. One reason why Airy’s equation is of interest is that for x negative the solutions are similar to 
trigonometric functions, and for x positive they are similar to hyperbolic functions. Can you explain why 
it is reasonable to expect such behavior? 
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For the sequence 0 O , a 3 , 06 , a 9 , ... we set n = 1,4,7,10,... in the recurrence relation: 

_ a 0 _ a 3 _ a () __ a 6 _ a () 

° 3 ~ 2^3’ ° 6 ~ 5^6 _ 2-3-5- 6 ’ ^ ~ 8~^9 _ 2-3-5-6-8-9’'"' 

These results suggest the general formula 

_ a ° ^ A 

a3n ~ 2 • 3 • 5 • 6 • • • (3n — l)(3w) ’ " “ ' 

For the sequence 01 , 04 , 07 , 010 ,..., we set n = 2,5,8,11,... in the recurrence relation: 
01 04 0 i 07 0 i 

= 3~4’ Ul= 6~7 = 3-4-6-7’ fll ° = 9 • 10 = 3 • 4 • 6 • 7 • 9 • 10’" " 

In general, we have 


01 , 

a 3n+i 3 . 4 . 6 . 7 ... (3n)(3n + 1 ) ’ W _ 

Thus the general solution of Airy’s equation is 

X'’ X ^ 

+ 2^3 + 2 • 3 • 5 • 6 + " ' + 2 • 3 • • • (3m — 1)(3«) + " 

r x 4 x 7 x 3n+1 

+ fll [ X + 3^4 + 3 • 4 • 6 • 7 + ''' + 3 • 4 • • • (3n)(3« + 1) + ' ‘' 


y = «o 1 


( 20 ) 


Having obtained these two series solutions, we can now investigate their convergence. 
Because of the rapid growth of the denominators of the terms in the series (20), we might 
expect these series to have a large radius of convergence. Indeed, it is easy to use the ratio test 
to show that both of these series converge for all x; see Problem 20. 

Assuming for the moment that the series do converge for all x, let y 1 and y 2 denote the 
functions defined by the expressions in the first and second sets of brackets, respectively, 
in Eq. (20). Then, by choosing first a 0 = 1, 0 i = 0 and then a 0 = 0 ,01 = 1, it follows that yi 
and y 2 are individually solutions of Eq. (15). Notice that yi satisfies the initial conditions 
y x (0) = 1, y,(0) = 0 and that y 2 satisfies the initial conditions ^(0) = 0, y' 2 { 0) = 1. Thus 
^Cyi^XO) = 1^0, and consequently yi and y 2 are a fundamental set of solutions. Hence 
the general solution of Airy’s equation is 

y = 0 oyi(x) + 0 i^ 2 (x), —oo < x < oo. 

In Figures 5.2.3 and 5.2.4, respectively, we show the graphs of the solutions yi and y 2 of 
Airy’s equation, as well as graphs of several partial sums of the two series in Eq. (20). Again, 
the partial sums provide local approximations to the solutions in a neighborhood of the origin. 
Although the quality of the approximation improves as the number of terms increases, no 
polynomial can adequately represent yi and y 2 for large |x|. A practical way to estimate the 
interval in which a given partial sum is reasonably accurate is to compare the graphs of that 
partial sum and the next one, obtained by including one more term. As soon as the graphs 
begin to separate noticeably, we can be confident that the original partial sum is no longer 
accurate. For example, in Figure 5.2.3 the graphs for n = 24 and n = 21 begin to separate 
at about x = —9/2. Thus, beyond this point, the partial sum of degree 24 is worthless as an 
approximation to the solution. 
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FIGURE 5.2.3 Polynomial approximations to the solution y 1 (x) of Airy’s equation. 
The value of n is the degree of the approximating polynomial. 



FIGURE 5.2.4 Polynomial approximations to the solution y 2 to of Airy’s equation. 

The value of n is the degree of the approximating polynomial. 

Observe that both y\ and y 2 are monotone for x > 0 and oscillatory for x < 0. You can 
also see from the figures that the oscillations are not uniform but, rather, decay in amplitude 
and increase in frequency as the distance from the origin increases. In contrast to Example 1, 
the solutions y\ and y 2 of Airy’s equation are not elementary functions that you have already 
encountered in calculus. However, because of their importance in some physical applications, 
these functions have been extensively studied, and their properties are well known to applied 
mathematicians and scientists. 


EXAMPLE 

3 


Find a solution of Airy’s equation in powers of x — 1. 

The point x = 1 is an ordinary point of Eq. (15), and thus we look for a solution of the form 

00 

y = y^a n {x - l) n , 

n =0 







262 


Chapter 5. Series Solutions of Second Order Linear Equations 


where we assume that the series converges in some interval |x — 11 < p. Then 

oo oo 

y' = ^ na n (x - l) n_1 = ^(n + l)a n+1 (x - l) n , 

n =1 n =0 

and 

oo oo 

y" = Yn(n - 1 )a n (x - V) n ~ 2 = ^(n + 2)(n + l)a n+2 (x - l) n . 

n=2 n=0 

Substituting for y and y" in Eq. (12), we obtain 

oo oo 

yy_in + 2 )(n + l)a„ +2 (x - 1 )" = x^a„(x - 1 )". 


( 21 ) 


Now to equate the coefficients of like powers of (x — 1), we must express x, the coefficient of y 
in Eq. (15), in powers of x — 1; that is, we write x = 1 + (x — 1). Note that this is precisely the 
Taylor series for x about x = 1. Then Eq. (21) takes the form 

oo oo 

+ 2)(n + l)a n+2 (x - 1 )" = [1 + (x - 1 )] ^ a n (x - 1 )" 


n =0 


n =0 


= y^a n (x - 1)" + y^a„(x - 1) B+1 . 

n=0 n=0 

Shifting the index of summation in the second series on the right gives 

oo oo oo 

7 > + 2 ){n + l)a„ +2 (x - 1 )" = y2 a n(x - 1 )" + y^a„_i(x - l)". 


n=0 


n =0 


n=l 


Equating coefficients of like powers of x — 1, we obtain 

2a 2 = flo» 

(3 • 2)a 3 = 

(4 • 3)a 4 = a 2 + a\, 

(5 • 4)a 5 = a 3 + a 2 , 


The general recurrence relation is 

(n + 2){n + l)a n+2 = a n + a n -\ for n> 1 . ( 22 ) 


Solving for the first few coefficients a n in terms of ao and a\, we find that 


«2 




Hence 


a\ a 0 
? + 6 ' 


a 2 a\ ao a\ 
^=12 + 12 = 24 + 12’ 


_ 03 _ ao a\ 

fl5_ 20 + 20 _ 30 + 120' 


y = ao ^1 + 


(x - l ) 2 (x - l ) 3 (x - l ) 4 (x - l ) 5 


24 


30 


r . (x — i ) 3 (x — i ) 4 (x — i ) 5 

+ a x (x - 1 ) + . + _ + + • 


12 


120 


(23) 


In general, when the recurrence relation has more than two terms, as in Eq. (22), the deter¬ 
mination of a formula for a n in terms ao and a\ will be fairly complicated, if not impossible. In 
this example such a formula is not readily apparent. Lacking such a formula, we cannot test the 
two series in Eq. (23) for convergence by direct methods such as the ratio test. However, we 
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shall see in Section 5.3 that even without knowing the formula for a n , it is possible to establish 
that the two series in Eq. (23) converge for all x. Further, they define functions y 3 and y 4 that 
are a fundamental set of solutions of the Airy equation (15). Thus 

y = a 0 y 3 (x) + a 4 y 4 (x) 

is the general solution of Airy’s equation for — oo < x < oo. 

It is worth emphasizing, as we saw in Example 3, that if we look for a solution 

oo 

of Eq. (1) of the form y = ^2 a n (x — xf ) n , then the coefficients P(x ), Q{x ), and R(x) 

n =0 

in Eq. (1) must also be expressed in powers of x — jcq- Alternatively, we can make 
the change of variable x — xo = t, obtaining a new differential equation for y as a 

oo 

function of t , and then look for solutions of this new equation of the form a n t n . 

n —0 

When we have finished the calculations, we replace t by x — x$ (see Problem 19). 

In Examples 2 and 3 we have found two sets of solutions of Airy’s equation. The 
functions y 4 and y 2 defined by the series in Eq. (20) are a fundamental set of solutions 
of Eq. (15) for all x, and this is also true for the functions y 3 and y 4 defined by the series 
in Eq. (23). According to the general theory of second order linear equations, each 
of the first two functions can be expressed as a linear combination of the latter two 
functions, and vice versa—a result that is certainly not obvious from an examination 
of the series alone. 

Finally, we emphasize that it is not particularly important if, as in Example 3, we are 
unable to determine the general coefficient a n in terms of ao and a\. What is essential 
is that we can determine as many coefficients as we want. Thus we can find as many 
terms in the two series solutions as we want, even if we cannot determine the general 
term. While the task of calculating several coefficients in a power series solution is 
not difficult, it can be tedious. A symbolic manipulation package can be very helpful 
here; some are able to find a specified number of terms in a power series solution in 
response to a single command. With a suitable graphics package we can also produce 
plots such as those shown in the figures in this section. 


PROBLEMS In each of Problems 1 through 14: 

(a) Seek power series solutions of the given differential equation about the given point x 0 ; 
find the recurrence relation. 

(b) Find the first four terms in each of two solutions yi and y 2 (unless the series terminates 
sooner). 

(c) By evaluating the Wronskian W(yi,y 2 )(xo), show that y 4 and y 2 form a fundamental set 
of solutions. 

(d) If possible, find the general term in each solution. 


1. f -y = 0, x 0 = 0 

3. y" —xy'—y — 0, x 0 = 1 

5. (1 — x)y" + y = 0, x 0 = 0 

7. /' + xy' + 2y = 0, x 0 = 0 

9. (1 + x 2 )y" - 4 xy' + 6y = 0, x 0 = 0 


2 . y" — xy' — y = 0 , x 0 = 0 
4. y" + k 2 x 2 y = 0, x 0 = 0, A: a constant 
6 . (2 + x 2 )y" — xy' + 4y = 0, x 0 = 0 
8 . xy" +y'+xy = 0 , x 0 = 1 
10. (4 - x 2 )y" + 2y = 0, x 0 = 0 
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11. (3 - x 2 )y" - 3 xy' — y = 0, x 0 = 0 

12 . (1 - x)y" + xy' — y = 0, x 0 = 0 

13. 2y" + x/ + 3}; = 0, xo = 0 

14. 2y" + (x + 1)/ + 3y = 0, x 0 = 2 

In each of Problems 15 through 18: 

(a) Find the first five nonzero terms in the solution of the given initial value problem. 

(b) Plot the four-term and the five-term approximations to the solution on the same axes. 

(c) From the plot in part (b) estimate the interval in which the four-term approximation is 
reasonably accurate. 

^2/ 15. y" — xy' — y = 0, y(0) = 2, y' (0) = 1; see Problem 2 

fflz 16. (2 + x 2 )y" — xy' + 4y = 0, y(0) = —1, y'(0) = 3; see Problem 6 

17. y" + xy' + 2y = 0, y(0) = 4, y'( 0) = — 1; see Problem 7 

18. (1 — x)y" 4-xy' — y = 0, y(0) = —3, /(0) = 2; see Problem 12 

19. (a) By making the change of variable x — 1 = t and assuming that y has a Taylor series in 
powers of t , find two series solutions of 

y" + (x - 1) V + (x 2 - l)y = 0 

in powers of x — 1. 

(b) Show that you obtain the same result by assuming that y has a Taylor series in powers 
of x — 1 and also expressing the coefficient x 2 — 1 in powers of x — 1. 

20. Show directly, using the ratio test, that the two series solutions of Airy’s equation about 
x = 0 converge for all x; see Eq. (20) of the text. 

21. The Hermite Equation. The equation 

y" — 2xy' + Xy = 0, —oo < x < oo, 

where X is a constant, is known as the Hermite 5 equation. It is an important equation in 
mathematical physics. 

(a) Find the first four terms in each of two solutions about x = 0 and show that they form 
a fundamental set of solutions. 

(b) Observe that if A, is a nonnegative even integer, then one or the other of the series 
solutions terminates and becomes a polynomial. Find the polynomial solutions for X = 0, 
2, 4, 6, 8, and 10. Note that each polynomial is determined only up to a multiplicative 
constant. 

(c) The Hermite polynomial H n (x) is defined as the polynomial solution of the Hermite 
equation with X = 2n for which the coefficient of x n is 2 n . Find H 0 (x),..., H 5 (x). 

22. Consider the initial value problem y' = y/l — y 2 ,y( 0) = 0. 

(a) Show that y = sinx is the solution of this initial value problem. 

(b) Look for a solution of the initial value problem in the form of a power series about 
x = 0. Find the coefficients up to the term in x 3 in this series. 


5 Charles Hermite (1822-1901) was an influential French analyst and algebraist. An inspiring teacher, he 
was professor at the Ecole Polytechnique and the Sorbonne. He introduced the Hermite functions in 1864 
and showed in 1873 that e is a transcendental number (that is, e is not a root of any polynomial equation 
with rational coefficients). His name is also associated with Hermitian matrices (see Section 7.3), some of 
whose properties he discovered. 
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In each of Problems 23 through 28, plot several partial sums in a series solution of the given 
initial value problem about x = 0, thereby obtaining graphs analogous to those in Figures 5.2.1 
through 5.2.4. 

23. y" — xy' — y = 0, y(0) = 1, y'(0) = 0; see Problem 2 

24. (2 + x 2 )y" — xy' + 4y = 0, y(0) = 1, y'(0) = 0; see Problem 6 

25. y" + xy' + 2y = 0, y(0) = 0, y'(0) = 1; see Problem 7 

26. (4 — x 2 )y" + 2y = 0, y(0) = 0, y'(0) = 1; see Problem 10 

27. y" + x 2 y = 0, y(0) = 1, y'(0) = 0; see Problem 4 

28. (1 - x)y" + xy' - 2y = 0, y(0) = 0, y'(0) = 1 


5.3 Series Solutions Near an Ordinary Point, Part II 


In the preceding section we considered the problem of finding solutions of 

P(x)y" + Q(x)y' + R(x)y = 0, (1) 

where P, Q , and R are polynomials, in the neighborhood of an ordinary point xo. 
Assuming that Eq. (1) does have a solution y = 0(x) and that 0 has a Taylor series 

oo 

y = <P(x) = E Un ^ x - *o)” ( 2 ) 

n =0 

that converges for \x — xo | < p , where p > 0, we found that the a n can be determined 
by directly substituting the series (2) for y in Eq. (1). 

Let us now consider how we might justify the statement that if xo is an ordinary 
point of Eq. (1), then there exist solutions of the form (2). We also consider the 
question of the radius of convergence of such a series. In doing this, we are led to a 
generalization of the definition of an ordinary point. 

Suppose, then, that there is a solution of Eq. (1) of the form (2). By differentiating 
Eq. (2) m times and setting x equal to xo, we obtain 

m\a m = 0 (m) Cx o ). 

Hence, to compute a n in the series (2), we must show that we can determine (x {) ) 
for n = 0,1,2,... from the differential equation (1). 

Suppose that y = 0(x) is a solution of Eq. (1) satisfying the initial conditions 
y(x 0 ) = Fo,/(xo) = y' 0 . Then ao = yo and a\ = y' 0 - If we are solely interested in finding 
a solution of Eq. (1) without specifying any initial conditions, then ao and a\ remain 
arbitrary. To determine 0 (w) (xo) and the corresponding a n for n = 2,3,..., we turn to 
Eq. (1). Since 0 is a solution of Eq. (1), we have 

P(x)0 // (x) + g(x)0 / (x) + i?(x)0(x) = 0. 

For the interval about xo for which P is nonzero, we can write this equation in the form 

0 // (x) = -p(x)0'(x) - #(x)0(x), (3) 

where p{x) = Q(x)/P{x) and q{x) = R{x)/P{x). Setting x equal to xo in Eq. (3) gives 
0"(x o ) = -p(x o )0 r (x o ) - g(x o )0(xo). 
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Theorem 5.3.1 


Hence a 2 is given by 


2 \a 2 = <p"(x o) = -p(x {) )a\ - q(x 0 )a 0 . 


(4) 


To determine a 3 , we differentiate Eq. (3) and then set x equal to x», obtaining 


3!«3 = 4>"'(x 0 ) = 


-W + ip' + q)<P' + q'<p\ 


x=x 0 


= -2\p(xo)a 2 - [p\x 0 ) + q(xo)]ai - q\xo)a 0 . 


(5) 


Substituting for a 2 from Eq. (4) gives a 2 in terms of a\ and a o. Since P , Q , and R are 
polynomials and P{x o) 7 ^ 0, all the derivatives of p and q exist at x$. Hence, we can 
continue to differentiate Eq. (3) indefinitely, determining after each differentiation 
the successive coefficients 04,05, ... by setting x equal to xo- 
Notice that the important property that we used in determining the a n was that 
we could compute infinitely many derivatives of the functions p and q. It might seem 
reasonable to relax our assumption that the functions p and q are ratios of polyno¬ 
mials and simply require that they be infinitely differentiable in the neighborhood of 
xo . Unfortunately, this condition is too weak to ensure that we can prove the conver¬ 
gence of the resulting series expansion for y = 0(x). What is needed is to assume that 
the functions p and q are analytic at xo; that is, they have Taylor series expansions that 
converge to them in some interval about the point xq : 


00 


p(x) = Po + Pl(x — Xq) + ■ ■ 

’ • + Pn( x ~ x o) n + • • 

• = y^Pn(x-Xo) n , 

n= 0 

(6) 

q(x) = <70 + qi(x - x 0 ) + •• 

■ • + qn(x ~ x o) n + • • 

00 

• = y^q„(x-x of. 
n= 0 

(7) 


With this idea in mind, we can generalize the definitions of an ordinary point and a 
singular point of Eq. (1) as follows: if the functions/? = Q/P and q = R/P are analytic 
at xo, then the point xo is said to be an ordinary point of the differential equation ( 1 ); 
otherwise, it is a singular point. 

Now let us turn to the question of the interval of convergence of the series solution. 
One possibility is actually to compute the series solution for each problem and then 
to apply one of the tests for convergence of an infinite series to determine its radius 
of convergence. Unfortunately, these tests require us to obtain an expression for the 
general coefficient a n as a function of n , and this task is often quite difficult, if not 
impossible; recall Example 3 in Section 5.2. However, the question can be answered 
at once for a wide class of problems by the following theorem. 


If xo is an ordinary point of the differential equation ( 1 ) 

P(x)y" + Q(x)? + R(x)y = 0, 

that is, if p = Q/P and q = R/P are analytic at xo, then the general solution of 
Eq. (1) is 

00 

y = E a n(x - x 0 ) n = aoyi(x) + a\y 2 (x). 


( 8 ) 
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EXAMPLE 

1 


where ao and a\ are arbitrary, and y\ and y 2 are two power series solutions that are 
analytic at xo. The solutions y± and y 2 form a fundamental set of solutions. Further, 
the radius of convergence for each of the series solutions yi and y 2 is at least as 
large as the minimum of the radii of convergence of the series for p and q. 


To see that y\ and y 2 are a fundamental set of solutions, note that they have the 

form yi{x) = 1 + b 2 (x - x 0 ) 2 H-and y 2 (x) = (x - x 0 ) + c 2 (x - x 0 ) 2 H-, where 

b 2 + C 2 = # 2 - Hence y\ satisfies the initial conditions yi(xo) = 1, y[(x 0 ) = 0, and y 2 
satisfies the initial conditions y 2 (xo) = 0 ,y 2 (^o) = 1. Thus W(yi,y 2 )(xo) = 1. 

Also note that although calculating the coefficients by successively differenti¬ 
ating the differential equation is excellent in theory, it is usually not a practical 
computational procedure. Rather, you should substitute the series (2) for y in the dif¬ 
ferential equation ( 1 ) and determine the coefficients so that the differential equation 
is satisfied, as in the examples in the preceding section. 

We will not prove this theorem, which in a slightly more general form was estab¬ 
lished by Fuchs . 6 What is important for our purposes is that there is a series solution 
of the form ( 2 ) and that the radius of convergence of the series solution cannot be 
less than the smaller of the radii of convergence of the series for p and q\ hence we 
need only determine these. 

This can be done in either of two ways. Again, one possibility is simply to compute 
the power series for p and q and then to determine the radii of convergence by 
using one of the convergence tests for infinite series. However, there is an easier 
way when P, Q, and R are polynomials. It is shown in the theory of functions of a 
complex variable that the ratio of two polynomials, say, Q/P, has a convergent power 
series expansion about a point x = xo if P{x 0 ) 7 ^ 0. Further, if we assume that any 
factors common to Q and P have been canceled, then the radius of convergence of 
the power series for Q/P about the point xo is precisely the distance from x 0 to the 
nearest zero of P. In determining this distance, we must remember that P(x) = 0 may 
have complex roots, and these must also be considered. 


What is the radius of convergence of the Taylor series for (1 + x 2 ) 1 about x = 0? 

One way to proceed is to find the Taylor series in question, namely, 

= 1 -x 2 +x 4 -x 6 + ■ ■ ■ + (-l) n x 2n + ■■■. 

1+x 2 

Then it can be verified by the ratio test that p = 1. Another approach is to note that the zeros of 
1+x 2 arex = ±i. Since the distance in the complex plane from 0 to i or to —i is 1, the radius 
of convergence of the power series about x = 0 is 1. 


6 Lazarus Immanuel Fuchs (1833-1902), a German mathematician, was a student and later a professor at 
the University of Berlin. He proved the result of Theorem 5.3.1 in 1866. His most important research was 
on singular points of linear differential equations. He recognized the significance of regular singular points 
(Section 5.4), and equations whose only singularities, including the point at infinity, are regular singular 
points are known as Fuchsian equations. 
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EXAMPLE 

2 

What is the radius of convergence of the Taylor series for (x 2 — 2x + 2) 1 about x = 0? about 
x = l? 

First notice that 

x 2 - 2x + 2 = 0 

has solutions x = 1 ± i. The distance in the complex plane from x = 0 to either x = 1 + i or 

oo 

x = 1 — / is >/2; hence the radius of convergence of the Taylor series expansion J2 a n% n about 

. nr n =0 

x = 0 is \/2. 

The distance in the complex plane from x = 1 to either x = 1 + / or x = 1 — / is 1; hence the 

oo 

radius of convergence of the Taylor series expansion J2 b n (x — l) n about x = 1 is 1. 

n= 0 

According to Theorem 5.3.1, the series solutions of the Airy equation in Examples 
2 and 3 of the preceding section converge for all values of x and x — 1, respectively, 
since in each problem P(x) = 1 and hence is never zero. 

A series solution may converge for a wider range of x than indicated by Theorem 
5.3.1, so the theorem actually gives only a lower bound on the radius of convergence 
of the series solution. This is illustrated by the Legendre polynomial solution of the 
Legendre equation given in the next example. 

EXAMPLE 

3 

Determine a lower bound for the radius of convergence of series solutions about x = 0 for the 
Legendre equation 

(1 — x 2 )y" — 2 xy' + a(a + 1 )y = 0, 

where a is a constant. 

Note that P(x) = 1 — x 2 , Q(x) = — 2x, and R(x) = a (a + 1) are polynomials, and that the 
zeros of P, namely, x = ±1, are a distance 1 from x = 0. Hence a series solution of the form 

oo 

J2 a n x n converges at least for |x | < 1, and possibly for larger values of x. Indeed, it can be shown 

n =0 

that if a is a positive integer, one of the series solutions terminates after a finite number of terms 
and hence converges not just for |x| < 1 but for all x. For example, if a = 1, the polynomial 
solution is y = x. See Problems 22 through 29 at the end of this section for a further discussion 
of the Legendre equation. 

EXAMPLE 

4 

Determine a lower bound for the radius of convergence of series solutions of the differential 
equation 

(1 + x 2 )y" + 2 xy' + 4x 2 y = 0 (9) 

about the point x = 0; about the point x = — |. 

Again P , Q , and R are polynomials, and P has zeros at x = ±i. The distance in the complex 
plane from 0 to ±i is 1, and from — \ to ±i is Jl + \ = a/ 5/2. Hence in the first case the 

oo oo 

series J2 a nX n converges at least for |x| < 1, and in the second case the series J2 (x + \) n 

n =0 n =0 

converges at least for |x + \ \ < a/5/2. 

An interesting observation that we can make about Eq. (9) follows from Theorems 3.2.1 
and 5.3.1. Suppose that initial conditions y(0) = y 0 and /(0) = y q are given. Since 1 + x 2 ^ 0 
for all x, we know from Theorem 3.2.1 that there exists a unique solution of the initial value 
problem on — oo < x < oo. On the other hand,Theorem 5.3.1 only guarantees a series solution 

oo 

of the form J2 a nX n (with a 0 = yo ? ^i = y'o) for — 1 < x < 1. The unique solution on the interval 

n =0 

—oo < x < oo may not have a power series about x = 0 that converges for all x. 
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EXAMPLE 

5 


Can we determine a series solution about x = 0 for the differential equation 

y" + (sinx)/ + (1 + x * 1 2 )y = 0, 
and if so, what is the radius of convergence? 

For this differential equation, p(x) = sinx and q{x ) = 1 + x 2 . Recall from calculus that sinx 
has a Taylor series expansion about x = 0 that converges for all x. Further, q also has a Taylor 
series expansion about x = 0, namely, q(x) = 1 +x 2 , that converges for all x. Thus there is 

oo 

a series solution of the form y = J2 a nX n with a o and a\ arbitrary, and the series converges 
for all x. n=0 


PROBLEMS In each of Problems 1 through 4, determine 0"(x o ), 0"'(x 0 ), and 0 (4) (x 0 ) for the given point x 0 

if y = 0(x) is a solution of the given initial value problem. 

1 . y" + xy' + y = 0; y(0) = 1 , /(0) = 0 

2. y" + (sinx)/ + (cosx)y = 0; y(0) = 0, /(0) = 1 

3. x 2 y" + (1 + x)/ + 3(lnx)y = 0; y( 1) = 2, /(1) = 0 

4. y" + x 2 / + (sinx)y = 0; y(0) = a 0 , /(0) = a x 

In each of Problems 5 through 8, determine a lower bound for the radius of convergence of 
series solutions about each given point x 0 for the given differential equation. 

5. y" + 4/ + 6xy = 0; x 0 = 0, x 0 = 4 

6. (x 2 — 2x — 3 )y" + xy' + 4y = 0; x 0 = 4, x 0 = -4, x 0 = 0 

7. (1 + x 3 4 5 6 )/ ; + 4x/ + y = 0; x 0 = 0, x 0 = 2 

8. xy /; + y = 0; x 0 = 1 

9. Determine a lower bound for the radius of convergence of series solutions about the given 
x 0 for each of the differential equations in Problems 1 through 14 of Section 5.2. 

10. The Chebyshev Equation. The Chebyshev 7 8 9 10 differential equation is 

(1 - x 2 )y" - xy' + a 2 y = 0, 


where a is a constant. 

(a) Determine two solutions in powers of x for |x| < 1, and show that they form a 
fundamental set of solutions. 

(b) Show that if a is a nonnegative integer n , then there is a polynomial solution of 
degree n. These polynomials, when properly normalized, are called the Chebyshev 
polynomials. They are very useful in problems that require a polynomial approximation 
to a function defined on — 1 < x < 1. 

(c) Find a polynomial solution for each of the cases a = n = 0,1,2,3. 


7 Pafnuty L. Chebyshev (1821-1894), the most influential nineteenth-century Russian mathematician, was 
for 35 years professor at the University of St. Petersburg, which produced a long line of distinguished 
mathematicians. His study of Chebyshev polynomials began in about 1854 as part of an investigation of 
the approximation of functions by polynomials. Chebyshev is also known for his work in number theory 
and probability. 
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For each of the differential equations in Problems 11 through 14, find the first four nonzero 
terms in each of two power series solutions about the origin. Show that they form a fundamental 
set of solutions. What do you expect the radius of convergence to be for each solution? 

11. y" + (sinx)y = 0 12. e x y" + xy = 0 

13. (cosx)/' + xy' — 2y = 0 14. e~ x y" + ln(l + x)/ — xy = 0 

15. Let x and x 2 be solutions of a differential equation P(x)y" + Q(x)y' + R(x)y = 0. Can you 
say whether the point x = 0 is an ordinary point or a singular point? Prove your answer. 

First Order Equations. The series methods discussed in this section are directly applicable 
to the first order linear differential equation P(x)y' + Q(x)y = 0 at a point x 0 , if the function 
p = Q/P has a Taylor series expansion about that point. Such a point is called an ordinary 

oo 

point, and further, the radius of convergence of the series y = J2 a n( x ~ x o) n is at least as large 

n =0 

as the radius of convergence of the series for Q/P. In each of Problems 16 through 21, solve the 
given differential equation by a series in powers of x and verify that a 0 is arbitrary in each case. 
Problems 20 and 21 involve nonhomogeneous differential equations to which series methods 
can be easily extended. Where possible, compare the series solution with the solution obtained 
by using the methods of Chapter 2. 

16. y —y = 0 17. y’ — xy — 0 

18. y = e* y, three terms only 19. (1 — x)y' = y 

20. y' - y =x 2 21. / + xy = 1 + x 

The Legendre Equation. Problems 22 through 29 deal with the Legendre 8 equation 

(1 — x 2 )y" — 2 xy' + a(a + l)y = 0. 


As indicated in Example 3, the point x = 0 is an ordinary point of this equation, and the distance 
from the origin to the nearest zero of P(x) = 1 — x 2 is 1. Hence the radius of convergence of 
series solutions about x = 0 is at least 1. Also notice that we need to consider only a > — 1 
because if a < — 1, then the substitution a = — (1 + y), where y > 0, leads to the Legendre 
equation (1 — x 2 )y /; — 2xy' + y(y + l)y = 0. 

22. Show that two solutions of the Legendre equation for |x| < 1 are 


a(a + 1) 2 a(a-2)(of + l)(a + 3) 4 

yi(x) = 1-—-x 4---x 


2 ! 


4! 


—2m+ 2)(a' + l)-••((* +2ra-l) 2m 
+ 4 ( (2m)! * ’ 


, , (a-l)(or + 2) 3 (ar-l)(a-3)(a + 2)(ar + 4) s 

y 2 (x) = x-—-x H-—-x 


3! 


5! 


, C/ 1 vn (“ - !)"•(“ - 2m + !)(« + 2) ■■■(a + 2m) 2m+1 

+ 2 - ( j (2m + l)! X • 


8 Adrien-Marie Legendre (1752-1833) held various positions in the French Academie des Sciences from 
1783 onward. His primary work was in the fields of elliptic functions and number theory. The Legendre 
functions, solutions of Legendre’s equation, first appeared in 1784 in his study of the attraction of spheroids. 
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23. Show that if a is zero or a positive even integer 2 n, the series solution yi reduces to a 
polynomial of degree 2 n containing only even powers of x. Find the polynomials corre¬ 
sponding to a = 0, 2, and 4. Show that if a is a positive odd integer 2n +1, the series 
solution y 2 reduces to a polynomial of degree In + 1 containing only odd powers of x. 
Find the polynomials corresponding to a = 1,3, and 5. 

24. The Legendre polynomial P n (x) is defined as the polynomial solution of the Legendre 
equation with a = n that also satisfies the condition P n ( 1) = 1. 

(a) Using the results of Problem 23, find the Legendre polynomials Pq(x), ..., Ps(x). 

(b) Plot the graphs of Po (x),..., Ps(x) for — 1 < x < 1. 

(c) Find the zeros of Po(*)>••• > P5 (x). 

25. It can be shown that the general formula for P n (x ) is 


Ln/2J 


1 

Pn(x) = 


k=0 


(—l)*(2n-2fc)! a 

k\{n — k)\(n — 2 k)\ 


where \n/2\ denotes the greatest integer less than or equal to n/2. By observing the form 
of P n (x) for n even and n odd, show that P n (— 1) = (—l) n . 

26. The Legendre polynomials play an important role in mathematical physics. For example, in 
solving Laplace’s equation (the potential equation) in spherical coordinates, we encounter 
the equation 


d 2 F((p) 

dcp 2 


+ cot<p 


dF((p) 

dcp 


+ n(n + l)F(<p) = 0, 


0 < (p < 7T, 


where n is a positive integer. Show that the change of variable x = cos (p leads to the 
Legendre equation with a = n for y = f(x) = F(arccosx). 

27. Show that for n = 0,1,2,3, the corresponding Legendre polynomial is given by 


1 d n 

P n {x) =--— (x 2 — l) n . 

2 n n\ dx nV 


This formula, known as Rodrigues’s formula, 9 is true for all positive integers n. 

28. Show that the Legendre equation can also be written as 

[(1 - x 2 )y']' = —a(a + 1 )y. 


Then it follows that 

[(1 -x 2 )P' n (x)]' = -n(n + l)P n (x) and [(1 - x 2 )P' m (x)]' = -m(m + l)P m (x). 

By multiplying the first equation by P m {x) and the second equation by P n (x), integrating 
by parts, and then subtracting one equation from the other, show that 

J P n {x)P m {x) dx = 0 if n ^ m. 

This property of the Legendre polynomials is known as the orthogonality property. If 
m = n, it can be shown that the value of the preceding integral is 2/(2 n + 1). 


9 Benjamin Olinde Rodrigues (1795-1851) published this result as part of his doctoral thesis from the 
University of Paris in 1815. He then became a banker and social reformer but retained an interest in 
mathematics. Unfortunately, his later papers were not appreciated until the late twentieth century. 
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29. Given a polynomial / of degree n, it is possible to express / as a linear combination of 

Po,Pl,P 2 , • • • 5 Pu¬ 
ri 

fix) = Y2 a k Pk(X). 

k =0 


Using the result of Problem 28, show that 


ak 


2k + 1 




f(x)Pk(x) dx. 


5.4 Euler Equations; Regular Singular Points 

In this section we will begin to consider how to solve equations of the form 

P(x)y" + Q(x)y'+ R{x)y = 0 (1) 

in the neighborhood of a singular point xo. Recall that if the functions P, Q , and R 
are polynomials having no factors common to all three of them, then the singular 
points of Eq. (1) are the points for which P(x) = 0. 

Euler Equations. A relatively simple differential equation that has a singular point is 

the Euler equation 10 

L[y] = x 2 y" + axy' + fiy = 0, (2) 

where a and are real constants. In this case P{x) = x 2 , so x = 0 is the only singu¬ 
lar point for Eq. (2); all other points are ordinary points. For convenience we first 
consider the interval x > 0 ; later we extend our results to the interval x < 0 . 

Observe that ( x r ) f = rx r_1 and ( x r )" = r(r — l)x r-2 . Hence, if we assume that 
Eq. (2) has a solution of the form 

y = x r ’ ( 3 ) 

then we obtain 

L[x r ] = x 2 (x0" + oix(x r )' + /3x r 

= x 2 r(r — l)x r ~ 2 + ckfx(rx r_1 ) + /3x r 
= x r [r(r - 1) + ar + fi\. (4) 

If r is a root of the quadratic equation 

F(r) = r(r - 1) + ar + /3 = 0 , (5) 

then L[x r ] is zero, and y = x r is a solution of Eq. (2). The roots of Eq. (5) are 

-(a - 1) ± y/(a- l ) 2 - 4/3 

n,r 2 = -2-’ ( 6 ) 

and F{r) = (r — ri)(r — r^). As for second order linear equations with constant coef¬ 
ficients, we consider separately the cases in which the roots are real and different, real 


10 This equation is sometimes called the Cauchy-Euler equation or the equidimensional equation. Euler 
studied it in about 1740, but its solution was known to Johann Bernoulli before 1700. 
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EXAMPLE 

1 


but equal, and complex conjugates. Indeed, the entire discussion of Euler equations 
is similar to the treatment of second order linear equations with constant coefficients 
in Chapter 3, with e rx replaced by x r . 

Real, Distinct Roots. If F(r) = 0 has real roots r\ and 7*2, with r\ ^ r 2 , then y\(x) = x n 
and y 2 (x) = x ri are solutions of Eq. (2). Since 

W(x r \x r2 ) = (j 2 — ri)x ri+r2 ~ 1 

is nonzero for r\ / r 2 and x > 0, it follows that the general solution of Eq. (2) is 

y = c\x ri + C2X ri , x > 0 . ( 7 ) 

Note that if r is not a rational number, then x r is defined by x r = e rlnx . 

Solve 

2x 2 y" + 3 xy' — y — 0, x > 0. (8) 

Substituting y = x r in Eq. (8) gives 

x r [2r(r — 1 ) + 3r - 1 ] = x r (2r 2 + r — 1 ) = x r (2r — 1 )(r + 1 ) = 0. 

Hence r\ — \ and r 2 = —1, so the general solution of Eq. (8) is 

y = cix 1/2 + c 2 x _1 , x > 0. (9) 


Equal Roots. If the roots r\ and V 2 are equal, then we obtain only one solution 
yi(x) = x ri of the assumed form. A second solution can be obtained by the method 
of reduction of order, but for the purpose of our future discussion we consider an 
alternative method. Since r\ = r 2 , it follows that F(r) = (r — r\) 2 . Thus in this case, 
not only does F{r\) = 0 but also F\r\) = 0. This suggests differentiating Eq. (4) with 
respect to r and then setting r equal to r\. By differentiating Eq. (4) with respect to 
r, we obtain 

^L[x r ] = ^[x r F{r)] = |-[V(r - rrf] 
ar ar dr 

= (r — ri) 2 x r lnx + 2(r — n)x r . (10) 


However, by interchanging differentiation with respect to x and with respect to r, we 
also obtain 


^L[x r ] = L 
dr 



L[x r lnx]. 


The right side of Eq. (10) is zero for r = r\\ consequently, L[xMnx] = 0 also. 
Therefore, 


y 2 (x) = x n lnx, x > 0 ( 11 ) 

is a second solution of Eq. (2). By evaluating the Wronskian of yiand y 2 , we find that 

W(x r \x n lnx)=x 2ri ~\ 


Hence x ri and x ri lnx are a fundamental set of solutions for x > 0, and the general 
solution of Eq. (2) is 

y = (ci + C 2 lnx)x ri , x > 0. (12) 
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EXAMPLE 

2 


EXAMPLE 

3 


Solve 


x 2 y" + 5xy' + 4y = 0, x > 0. 

Substituting y = x r in Eq. (13) gives 

x r [r(r - 1) + 5r + 4] = x r (r 2 + 4r + 4) = 0. 


Hence r\ = r 2 = —2, and 

y = x~ 2 (ci + C2 lnx), x > 0 
is the general solution of Eq. (13). 


(13) 


(14) 


Complex Roots. Finally, suppose that the roots r\ and r 2 of Eq. (5) are complex con¬ 
jugates, say, r\ = 1 + i/x and = X — i/i, with /x ^0. We must now explain what is 
meant by x r when r is complex. Remembering that 

V = e rlnx (15) 

when x > 0 and r is real, we can use this equation to define x r when r is complex. 
Then, using Euler’s formula for e^ lnx , we obtain 

_ g(X+i/ji) lnx _ gXlnXgi/jilnx _ ^X^ifilnx 

= x A [cos(/xlnx) +/sin(/r lnx)], x > 0. (16) 

With this definition of x r for complex values of r, it can be verified that the usual 
laws of algebra and the differential calculus hold, and hence x ri and x ri are indeed 
solutions of Eq. (2). The general solution of Eq. (2) is 

y = Cl x x+i ^ + c 2 x x -^. (17) 

The disadvantage of this expression is that the functions x A+ ^ and x x ~ 1 ^ are complex¬ 
valued. Recall that we had a similar situation for the second order differential 
equation with constant coefficients when the roots of the characteristic equation 
were complex. Just as we did then, we can use Theorem 3.2.6 to obtain real-valued 
solutions of Eq. (2) by taking the real and imaginary parts of x A+i/x , namely, 

x x cos (jx lnx) and x x sin(/x lnx). (18) 

A straightforward calculation shows that 

W[x x cos(/xlnx),x A sin(/zlnx)] = /xx 2A_1 . 

Hence these solutions form a fundamental set of solutions for x > 0, and the general 
solution of Eq. (2) is 

y = cix A cos(/xlnx) + C 2 X^ sin(/z lnx), x > 0. (19) 

Solve 

x 2 y" + x/ + y = 0. (20) 

Substituting y = x r in Eq. (20) gives 

x r [r(r - 1) + r + 1] = x r (r 2 + 1) = 0. 

Hence r = ±i, and the general solution is 

y = c 1 cos (lnx) + C2 sin(lnx), x > 0. (21) 

The factor x A does not appear explicitly in Eq. (21) because in this example 1 = 0 and x x = 1. 
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Now let us consider the qualitative behavior of the solutions of Eq. (2) near the 
singular point x = 0. This depends entirely on the values of the exponents r\ and 
First, if r is real and positive, then x r -> 0 as x tends to zero through positive values. 
On the other hand, if r is real and negative, then x r becomes unbounded. Finally, if 
r = 0, thenx r = 1. Figure 5.4.1 shows these possibilities for various values of r. If r is 
complex, then a typical solution is x A cos(/x In x). This function becomes unbounded or 
approaches zero if A is negative or positive, respectively, and also oscillates more and 
more rapidly as x 0. This behavior is shown in Figures 5.4.2 and 5.4.3 for selected 
values of A and \i. If A = 0, the oscillation is of constant amplitude. Finally, if there 
are repeated roots, then one solution is of the form x r In x, which tends to zero if r > 0 
and becomes unbounded if r < 0. An example of each case is shown in Figure 5.4.4. 



FIGURE 5.4.1 Solutions of an Euler equation; real roots. 
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FIGURE 5.4.2 Solution of an Euler equation; FIGURE 5.4.3 Solution of an Euler equation; 

complex roots with negative real part. complex roots with positive real part. 
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FIGURE 5.4.4 Typical second solutions of an Euler equation with equal roots. 
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The extension of the solutions of Eq. (2) into the interval x < 0 can be carried out 
in a relatively straightforward manner. The difficulty lies in understanding what is 
meant by x r when x is negative and r is not an integer; similarly, In x has not been 
defined for x < 0. The solutions of the Euler equation that we have given for x > 0 
can be shown to be valid for x < 0, but in general they are complex-valued. Thus in 
Example 1 the solution x 1/2 is imaginary for x < 0. 

It is always possible to obtain real-valued solutions of the Euler equation (2) in the 
interval x < 0 by making the following change of variable. Let x = — §, where § > 0, 
and let y = u{p). Then we have 

dy 
dx 

Thus, for x < 0, Eq. 


But except for names of the variables, this is exactly the same as Eq. (2); from Eqs. (7), 
(12), and (19), we have 


du 


du 

d 2 y 

d / 

du 

\ d$_ 

dt- 

dx 

”d?’ 

dx 2 

= d$ l 

~~dk, 

/ dx 

(2) 

takes the form 






9 d 2 u 

du 


= 0, 


0. 


£ 2 - 

5 dp 

+ “ f 5? 

+ fiu - 

% > 


d 2 u 

dp' 


( 22 ) 


(23) 


c ir 1 +c 2 r* 


«© = 


(Cl + C 2 In 

cip cos (fi In §) + c 2 p sin(/x In §), 


(24) 


depending on whether the zeros of F(r) = r(r — 1) + ar + /3 are real and different, 
real and equal, or complex conjugates. To obtain u in terms of x, we replace § by —x 
in Eqs. (24). 

We can combine the results for x > 0 andx < 0 by recalling that |x| = x whenx > 0 
and that |x| = —x whenx < O.Thus we need only replacex by |x| in Eqs. (7), (12), and 
(19) to obtain real-valued solutions valid in any interval not containing the origin. 

Hence the general solution of the Euler equation (2) 


x 2 y" + axy' + /3y = 0 


in any interval not containing the origin is determined by the roots r\ and r 2 of the 
equation 

F(r) = r(r — 1) + ar + ft = 0 


as follows. If the roots are real and different, then 


y = ci\x\ n +c 2 \x\ T2 . (25) 

If the roots are real and equal, then 

y = (c 1 + c 2 ln\x\)\x\ n . (26) 

If the roots are complex conjugates, then 

y = |x| A [a cos(/x In |x|) + C 2 sin(/x In |x|)], (27) 


where ri, r 2 = X ± //x. 
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The solutions of an Euler equation of the form 

(x - X()) 2 y" + a(x - x 0 )y' + fiy = 0 (28) 

are similar. If we look for solutions of the form y = (x — xo) r , then the general solution 
is given by Eq. (25), Eq. (26), or Eq. (27) with % replaced by x — xo. Alternatively, 
we can reduce Eq. (28) to the form of Eq. (2) by making the change of independent 
variable t — x — x o. 

Regular Singular Points. We now return to a consideration of the general equation (1) 

P(x)y" + Q(x)y’+ R(x)y = 0, 

where xo is a singular point. This means that P(x o) = 0 and that at least one of Q and 
R is not zero at xo. 

Unfortunately, if we attempt to use the methods of the preceding two sections to 
solve Eq. (1) in the neighborhood of a singular point xo, we find that these methods 
fail. This is because the solution of Eq. (1) is often not analytic at xo and consequently 
cannot be represented by a Taylor series in powers of x — xo. Examples 1, 2, and 3 
illustrate this fact; in each of these examples, the solution fails to have a power series 
expansion about the singular point x = 0. Therefore, to have any chance of solving 
Eq. (1) in the neighborhood of a singular point, we must use a more general type of 
series expansion. 

Since the singular points of a differential equation are usually few in number, we 
might ask whether we can simply ignore them, especially since we already know how 
to construct solutions about ordinary points. However, this is not feasible. The sin¬ 
gular points determine the principal features of the solution to a much larger extent 
than you might at first suspect. In the neighborhood of a singular point the solution 
often becomes large in magnitude or experiences rapid changes in magnitude. For 
example, the solutions found in Examples 1,2, and 3 are illustrations of this fact. Thus 
the behavior of a physical system modeled by a differential equation frequently is 
most interesting in the neighborhood of a singular point. Often geometric singular¬ 
ities in a physical problem, such as corners or sharp edges, lead to singular points 
in the corresponding differential equation. Thus, although at first we might want to 
avoid the few points where a differential equation is singular, it is precisely at these 
points that it is necessary to study the solution most carefully. 

As an alternative to analytical methods, we can consider the use of numerical 
methods, which are discussed in Chapter 8. However, these methods are ill suited 
for the study of solutions near a singular point. Thus, even if we adopt a numerical 
approach, it is advantageous to combine it with the analytical methods of this chapter 
in order to examine the behavior of solutions near singular points. 

Without any additional information about the behavior of Q/P and R/P in the 
neighborhood of the singular point, it is impossible to describe the behavior 
of the solutions of Eq. (1) near x = xo. It may be that there are two distinct solu¬ 
tions of Eq. (1) that remain bounded as x -> xo (as in Example 3); or there may be 
only one, with the other becoming unbounded as x -> xo (as in Example 1); or they 
may both become unbounded as x -> xo (as in Example 2). If Eq. (1) has solutions 
that become unbounded as x -> xo, it is often important to determine how these 
solutions behave as x -> xo. For example, does y oo in the same way as (x — xo) -1 
or |x — xo| -1/2 , or i n some other manner? 
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Our goal is to extend the method already developed for solving Eq. (1) near an 
ordinary point so that it also applies to the neighborhood of a singular point xo. 
To do this in a reasonably simple manner, it is necessary to restrict ourselves to cases 
in which the singularities in the functions Q/P and R/P at x = xo are not too severe— 
that is, to what we might call “weak singularities.” At this stage it is not clear exactly 
what is an acceptable singularity. However, as we develop the method of solution, 
you will see that the appropriate conditions (see also Section 5.6, Problem 21) to 
distinguish “weak singularities” are 


lim (x — xo) is finite 

P(x) 


(29) 


and 


9 i?(x) . „ . 

lim (x — xo) - is finite. 

x^x 0 P(x) 


(30) 


This means that the singularity in Q/P can be no worse than (x — xo) -1 and the singu¬ 
larity in R/P can be no worse than (x — xo) -2 . Such a point is called a regular singular 
point of Eq. (1). For equations with more general coefficients than polynomials, xo 
is a regular singular point of Eq. (1) if it is a singular point and if both 11 



(31) 


have convergent Taylor series about xo—that is, if the functions in Eq. (31) are analytic 
at x = xo. Equations (29) and (30) imply that this will be the case when P, Q , and R 
are polynomials. Any singular point of Eq. (1) that is not a regular singular point is 
called an irregular singular point of Eq. (1). 

Observe that the conditions in Eqs. (29) and (30) are satisfied by the Euler equation 
(28). Thus the singularity in an Euler equation is a regular singular point. Indeed, we 
will see that all equations of the form (1) behave very much like Euler equations near 
a regular singular point. That is, solutions near a regular singular point may include 
powers of x with negative or nonintegral exponents, logarithms, or sines or cosines 
of logarithmic arguments. 

In the following sections we discuss how to solve Eq. (1) in the neighborhood of a 
regular singular point. A discussion of the solutions of differential equations in the 
neighborhood of irregular singular points is more complicated and may be found in 
more advanced books. 


Determine the singular points of the Legendre equation 


EXAMPLE 


4 


(1 - x 2 )y" - 2 xy' + a (a + l)y = 0 


(32) 


and determine whether they are regular or irregular. 


n The functions given in Eq. (31) may not be defined at xo, in which case their values at xo are to be 
assigned as their limits as x -> xq. 
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EXAMPLE 

5 


EXAMPLE 

6 


In this case P(x) = 1 — x 2 , so the singular points are x = 1 and x = — 1. Observe that when 
we divide Eq. (32) byl — x 2 , the coefficients of/ andy are —2x/(l — x 2 ) anda(a + 1)/(1 — x 2 ), 
respectively. We consider the point x = 1 first. Thus, from Eqs. (29) and (30), we calculate 


lim(x — 1) 

x—> 1 


2x 

1 - X 2 


= lim 


(x — 1)(—2x) 


x-»l (1 - X)(l +X) 


= lim 


2x 


>i 1 + x 


= 1 


and 


lim(x - l) 2 


a(a + 1 ) 
1 - x 2 


(x - l) 2 a(a + 1) 

lim —---- 

x-+l (1—x)(l+x) 


r (x 1)( ot){oi T1) 

= lim---= 0. 

x—1 T x 


Since these limits are finite, the point x = 1 is a regular singular point. It can be shown in a 
similar manner that x = —1 is also a regular singular point. 


Determine the singular points of the differential equation 

2x(x — 2) 2 y" + 3x/ + (x — 2 )y = 0 

and classify them as regular or irregular. 

Dividing the differential equation by 2x(x — 2) 2 , we have 


/ + 




1 


2(x — 2) 2 2x(x — 2) 


y = o. 


so p{x) = Q{x)/P(x) = 3/2(x - 2) 2 and q(x) = R{x)/P{x) = l/2x(x - 2). The singular points 
are x = 0 and x = 2. Consider x = 0. We have 


limx/;(x) = limx—- —- 

x^o y x^o 2(x — 2) 2 


= 0, 


and 


limx 2 tf(x) = limx 2 --— 

x^o x^o 2x(x — 2) 


= 0 . 


Since these limits are finite, x = 0 is a regular singular point. For x = 2 we have 

3 3 

lim(x - 2)p(x) = lim(x - 2)—- — = lim —-—, 

X—>2 X—>2 2(x — 2) 2 X—>2 2(x — 2) 

so the limit does not exist; hence x = 2 is an irregular singular point. 


Determine the singular points of 

/ 7T \ ^ 

yx — —) y” + (cosx)y' + (sinx)y = 0 

and classify them as regular or irregular. 

The only singular point is x = tt/2. To study it, we consider the functions 


and 


(i(x-§)^- 


cosx 
X — 71/2 


= sinx. 
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Starting from the Taylor series for cos x about x = n/2, we find that 

COSX 1 (x — jt/2) * 2 (x — jt/2) 4 
x — jt/2 + 3! 5! 

which converges for all x. Similarly, sinx is analytic at x = jt/2. Therefore, we conclude that 
7t/2 is a regular singular point for this equation. 


PROBLEMS 


In each of Problems 1 through 12 , determine the general solution of the given differential 
equation that is valid in any interval not including the singular point. 

1 . x 2 y" + 4 xy' + 2y = 0 2 . (x + l) 2 y" + 3(x + 1 )/ + 0.75y = 0 

3. x 2 y" - 3 xy' + 4y = 0 4. x 2 y" + 3x/ + 5y = 0 


5. x 2 y" — xy' + y = 0 
7. x 2 y" + 6xy' - y = 0 
9. x 2 y" - 5x/ + 9y = 0 
11. x 2 y" + 2x/ + 4y = 0 


6. (x - 1) V + 8(x - 1)/ + 12y = 0 
8. 2x 2 y" - 4 xy' + 6y = 0 
10. (x - 2) 2 y" + 5(x — 2)y' + 8y = 0 
12. x 2 y" - 4x/ + 4y = 0 


In each of Problems 13 through 16, find the solution of the given initial value problem. Plot 
the graph of the solution and describe how the solution behaves as x 0. 

13. 2x 2 y /; + xy' — 3y = 0, y(l) = 1, /(1) = 4 

4ft, 14. 4x 2 y" + 8xy ; + 17y = 0, y( 1) = 2, /(1) = -3 

15. x 2 y" - 3xy' + 4y = 0, y(- 1) = 2, /(- 1) = 3 

16. X 2 /' + 3 xy' + 5y = 0, y( 1) = 1, /(l) = -1 


In each of Problems 17 through 34, find all singular points of the given equation and determine 
whether each one is regular or irregular. 

17. xy" + (1 - x)y' + xy = 0 18. x 2 (l - x) 2 y" + 2x/ + 4y = 0 

19. x 2 (l - x)y" + (x - 2)y' - 3xy = 0 20. x 2 (l - x 2 )y" + (2 /x)y' + 4y = 0 

21. (1 - x 2 ) 2 y" + x(l - x)y' + (1 + x)y = 0 

22. x 2 y ;/ + xy' + (x 2 — v 2 )y = 0, Bessel equation 

23. (x + 3 )y" - 2xy' + (1 - x 2 )y = 0 

24. x(l — x 2 ) 3 y" + (1 — x 2 ) 2 / + 2(1 + x)y = 0 

25. (x + 2) 2 (x — 1 )y" + 3(x — 1 )y' — 2(x + 2)y = 0 

26. x(3 — x)y" + (x + l)y' — 2y = 0 


27. (x 2 + x - 2 )y" + (x + 1)/ + 2y = 0 
29. y" + (In \x\)y' + 3xy = 0 
31. x 2 y" — 3(sinx)/ + (1 + x 2 )y = 0 
33. (sinx)/' + xy' + 4y = 0 


28. xy" + e^y' + (3 cos x)y = 0 
30. x 2 /' + 2{e x — 1 )y' + ( e~ x cosx)y = 0 
32. xy" + y' + (cotx)y = 0 

34. (x sinx)y" + 3y ; + xy = 0 

35. Find all values of a for which all solutions of x 2 y" + axy' + (5/2)y = 0 approach zero as 
x —> 0. 

36. Find all values of /3 for which all solutions of x 2 y" + fiy = 0 approach zero as x -> 0. 
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37. Find y so that the solution of the initial value problem x 2 y" — 2y = 0, y(l) = 1, y'(l) = y 
is bounded as x -> 0. 

38. Find all values of a for which all solutions of x 2 y" + axy' + (5/2)y = 0 approach zero as 

X 00. 

39. Consider the Euler equation x 2 y" + axy' + fiy = 0. Find conditions on a and ft so that: 

(a) All solutions approach zero as x 0. 

(b) All solutions are bounded as x 0. 

(c) All solutions approach zero as x oo. 

(d) All solutions are bounded as x oo. 

(e) All solutions are bounded both as x 0 and as x oo. 

40. Using the method of reduction of order, show that if r\ is a repeated root of 

r(r — 1) + ar + ft = 0, 

then x n and x n lnx are solutions of x 2 y" + axy' + fiy = 0 for x > 0. 

In each of Problems 41 and 42, show that the point x = 0 is a regular singular point. In each 

oo 

problem try to find solutions of the form J2 UnX n - Show that (except for constant multiples) 

n =0 

there is only one nonzero solution of this form in Problem 41 and that there are no nonzero 
solutions of this form in Problem 42. Thus in neither case can the general solution be found in 
this manner. This is typical of equations with singular points. 

41. 2xy" + 3/ + xy = 0 

42. 2x 2 y" + 3 xy' — (1 + x)y = 0 

43. Singularities at Infinity. The definitions of an ordinary point and a regular singular point 
given in the preceding sections apply only if the point x 0 is finite. In more advanced work 
in differential equations, it is often necessary to consider the point at infinity. This is done 
by making the change of variable £ = 1/x and studying the resulting equation at £ = 0. 
Show that, for the differential equation 

P(x)y" + Q(x)y' + R(x)y = 0, 

the point at infinity is an ordinary point if 

i ripam ea/si , Ram 

p( i/d L ? ? 2 J an mm 

have Taylor series expansions about § = 0. Show also that the point at infinity is a regular 
singular point if at least one of the above functions does not have a Taylor series expansion, 
but both 

$ ppam Q( i/©i d Ram 

p(ml % ? 2 J an mm 

do have such expansions. 

In each of Problems 44 through 49, use the results of Problem 43 to determine whether the 
point at infinity is an ordinary point, a regular singular point, or an irregular singular point of 
the given differential equation. 

44. y" + y = 0 

45. x 2 y" + xy' - 4y = 0 

46. (1 — x 2 )y" — 2xy' + a{a + l)y = 0, Legendre equation 
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47. x 2 y" + xy' + (x 2 — v 2 )y = 0, Bessel equation 

48. y" — 2xy' + Xy = 0, Hermite equation 

49. y" — xy = 0, Airy equation 


5.5 Series Solutions Near a Regular Singular Point, Part I 


We now consider the question of solving the general second order linear equation 

P(x)y" + Q(x)y'+ R(x)y = 0 (1) 

in the neighborhood of a regular singular point x = xo. For convenience we assume 
that xo = 0. If xo 7 ^ 0, we can transform the equation into one for which the regular 
singular point is at the origin by letting x — xo equal t. 

The assumption that x = 0 is a regular singular point of Eq. (1) means that 
xQ(x)/P(x) = xp(x) and x 2 R{x)/P{x) = x 2 q{x) have finite limits as x -> 0 and are 
analytic at x = 0. Thus they have convergent power series expansions of the form 

oo oo 

xp(x) = y]p„x", x 2 q(x) = y^q n x n , ( 2 ) 

n =0 n =0 

on some interval |x| < p about the origin, where p > 0. To make the quantities xp(x) 
and x 2 q{x) appear in Eq. (1), it is convenient to divide Eq. (1) by P(x) and then to 
multiply by x 2 , obtaining 

x 2 y" + x[xp(x)]/ + [x 2 q(x)]y = 0, (3) 


or 

x 2 /' + x(p 0 + P\X H-b p n x n H-)/ 

+ (Qo + (fax + • • • + q n x n + • • -)y = 0. (4) 

If all of the coefficients p n and q n are zero, except possibly 

.. xQ(x) x 2 R(x) 

p o = lim- and qn = lim-, (5) 

y P(x) H x^o P(x) v 7 

then Eq. (4) reduces to the Euler equation 

*y' + Poxy' + qoy = o, (6) 

which was discussed in the preceding section. In general, of course, some of the coef¬ 
ficients p n and q n , n > 1, are not zero. However, the essential character of solutions 
of Eq. (4) in the neighborhood of the singular point is identical to that of solu¬ 
tions of the Euler equation (6). The presence of the terms p\x +-b p n x n + • • • and 

q\x + • • • + q n x n + • • • merely complicates the calculations. 

We restrict our discussion primarily to the interval x > 0. The interval x < 0 can 
be treated, just as for the Euler equation, by making the change of variable x = —§ 
and then solving the resulting equation for § > 0 . 

The coefficients in Eq. (4) can be viewed as “Euler coefficients” times power series. 
To see this, you can write the coefficient of / in Eq. (4) as 

p 0 x[l + (Pl/p 0 )x + ( p 2 /Po)X 2 +-h (Pn/Po)X n H-], 
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and similarly for the coefficient of y. Thus it may seem natural to seek solutions of 
Eq. (4) in the form of “Euler solutions” times power series. Hence we assume that 

oo oo 

y = x r (ao + a\x + • • • + a n x n + •••)= x r ^ UnX n = ^ a n x r+n , (7) 

n =0 n =0 

where a$ ^ 0. In other words, r is the exponent of the first nonzero term in the series, 
and ao is its coefficient. As part of the solution, we have to determine: 

1. The values of r for which Eq. (1) has a solution of the form (7). 

2. The recurrence relation for the coefficients a n . 

oo 

3. The radius of convergence of the series J2 UnX n . 

n =0 

The general theory was constructed by Frobenius 12 and is fairly complicated. 
Rather than trying to present this theory, we simply assume, in this and the next 
two sections, that there does exist a solution of the stated form. In particular, we 
assume that any power series in an expression for a solution has a nonzero radius of 
convergence and concentrate on showing how to determine the coefficients in such 
a series. To illustrate the method of Frobenius, we first consider an example. 


EXAMPLE 

1 


Solve the differential equation 

2 x 2 y" - xy' + (1 + x)y = 0. (8) 

It is easy to show that x = 0 is a regular singular point of Eq. (8). Further, xp(x) = —1/2 
and x 2 q(x) = (1+x)/2.Thusp 0 = —l/2,q 0 = 1/2, qi = 1/2, and all other p’s andg’s are zero. 
Then, from Eq. (6), the Euler equation corresponding to Eq. (8) is 

2 x 2 y" — xy' + y = 0. (9) 

To solve Eq. (8), we assume that there is a solution of the form (7). Then y' and y" are 
given by 

oo 

y' — a n(r + rc)x r+n-1 (10) 

n =0 

and 

oo 

y" = J2a n (r + n)(r + n -l)x r+n ~ 2 . ( 11 ) 

n =0 

By substituting the expressions for y, /, and y" in Eq. (8), we obtain 


2x 2 /' — xy' + (1 + x)y = ^ 2 a n {r + ri)(r + n — l)x r+n 

n =0 

oo oo oo 

— a n (r + n)x r+n + ^ a n x r+n + ^ a n x r+n+1 . (12) 

n =0 n=0 n=0 


12 Ferdinand Georg Frobenius (1849-1917) grew up in the suburbs of Berlin, received his doctorate in 1870 
from the University of Berlin, and returned as professor in 1892. For most of the intervening years he was 
professor at the Eidgenossische Polytechnikum at Zurich. He showed how to construct series solutions 
about regular singular points in 1874. His most distinguished work, however, was in algebra, where he was 
one of the foremost early developers of group theory. 
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The last term in Eq. (12) can be written as J2 a n -ix r+n , so by combining the terms in Eq. (12), 
we obtain n=1 

2 x 2 y" — xy' + (1 + x)y = do[2r(r — 1) — r + l]x r 

oo 

+ ^ ' {[2(r + ri )(r + n — 1) — (r + ri) + 1] a n + a n -\ } x r+n — 0. (13) 

n =1 

If Eq. (13) is to be satisfied for all x, the coefficient of each power of x in Eq. (13) must be zero. 
From the coefficient of x r we obtain, since a 0 ^ 0, 

2 r(r - 1) - r + 1 = 2r 2 - 3r + 1 = (r - l)(2r - 1) = 0. (14) 

Equation (14) is called the indicial equation for Eq. (8). Note that it is exactly the polynomial 
equation we would obtain for the Euler equation (9) associated with Eq. (8). The roots of the 
indicial equation are 

rt = 1, r 2 = 1/2. (15) 

These values of r are called the exponents at the singularity for the regular singular point 
x = 0. They determine the qualitative behavior of the solution (7) in the neighborhood of the 
singular point. 

Now we return to Eq. (13) and set the coefficient of x r+n equal to zero. This gives the relation 
[2(r + n)(r + n - 1) - (r + ri) + 1] a n + a n -1 =0, n > 1, (16) 


or 


ttn —1 

2 (r + n) 2 — 3 (r + n) + 1 


fln—l 


[(r + n) — l][2(r + «) — !]’ 


n > 1. 


(17) 


For each root r\ and r 2 of the indicial equation, we use the recurrence relation (17) to determine 
a set of coefficients ai,a 2 ,_For r = r\ = 1, Eq. (17) becomes 


Thus 


d n — 


Cl\ = 


ttn—l 


(2 n + 1 )n ’ 


a 0 


n > 1. 


a 2 = 


3-1’ 

a\ 

~ 5^2 = 




and 


In general, we have 


d3 = — 


(3-5)(l-2)’ 

(? 2 00 
7^3 = _ (3 • 5 • 7)(1 • 2 • 3) 

(- 1 )" 


[3 • 5 • 7 • • • (2 n + 1 )]n! 


0o, 


n> 4. 


(18) 


If we multiply both the numerator and denominator of the right side of Eq. (18) by 
2 • 4 • 6 • • • 2 n = 2 n n\, we can rewrite d n as 


(~l) n 2 n 

d n = -00, 

" (2n + 1 )! 0 


n > 1. 
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Hence, if we omit the constant multiplier ao, one solution of Eq. (8) is 


yi(x) =x 


~ (—l) n 2 n 

i + £ ... . 


x > 0. 


“ (Zn +1)! 

To determine the radius of convergence of the series in Eq. (19), we use the ratio test: 


(19) 


lim 

n—>oo 


fln+lX 


■n +1 


a n x n 


= lim 


2|jc| 


n-+ oo (2 n + 2) (2/t + 3) 


= 0 


for all x. Thus the series converges for all x. 

Corresponding to the second root r = r 2 = ^,we proceed similarly. From Eq. (17) we have 


CL n — 


Mn —1 


fln—1 


2n (n — ~) n(2n — 1) ’ 


n > 1. 


Hence 


ai = - 


a 2 = 


a 3 = 


ap 

eT’ 


a\ 


ap 


2-3 (1 • 2)(1 • 3) ’ 


ap 


and, in general, 


a n — 


a 2 

'T5 = _ (1 • 2 • 3)(1 • 3 • 5) ’ 
(-ir 


n![l-3-5---(2«-l)] 


ap , 


n > 4. 


( 20 ) 


Just as in the case of the first root r\, we multiply the numerator and denominator by 
2 • 4 • 6 • • • 2 n = 2 n n\. Then we have 


(— l) n 2 n 

a ri — , , «0, 

(2 n)\ 


n > 1. 


Again omitting the constant multiplier ao, we obtain the second solution 

x > 0. 


^ ( _1 \no« 

y 2 (x) = x 1/2 1 + £ ^ x" 


(2 ri )\ 


( 21 ) 


As before, we can show that the series in Eq. (21) converges for all x. Since y 3 and y 2 behave 
like x and x 1/2 , respectively, near x = 0, they form a fundamental set of solutions. Hence the 
general solution of Eq. (8) is 

y = ciyiix) + c 2 y 2 (x), x > 0. 


The preceding example illustrates that if x = 0 is a regular singular point, then 
sometimes there are two solutions of the form (7) in the neighborhood of this point. 
Similarly, if there is a regular singular point at x = xo, then there may be two solutions 
of the form 

oo 

y = (X - x 0 y £ a„ (x - x 0 ) n (22) 

n —0 

that are valid near x = xo. However, just as an Euler equation may not have two 
solutions of the form y = x r , so a more general equation with a regular singular point 
may not have two solutions of the form (7) or (22). In particular, we show in the next 
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section that if the roots r\ and r 2 of the indicial equation are equal or differ by an 
integer, then the second solution normally has a more complicated structure. In all 
cases, though, it is possible to find at least one solution of the form (7) or (22); if r\ 
and r 2 differ by an integer, this solution corresponds to the larger value of r. If there 
is only one such solution, then the second solution involves a logarithmic term, just 
as for the Euler equation when the roots of the characteristic equation are equal. The 
method of reduction of order or some other procedure can be invoked to determine 
the second solution in such cases. This is discussed in Sections 5.6 and 5.7. 

If the roots of the indicial equation are complex, then they cannot be equal or differ 
by an integer, so there are always two solutions of the form (7) or (22). Of course, these 
solutions are complex-valued functions of x. However, as for the Euler equation, it 
is possible to obtain real-valued solutions by taking the real and imaginary parts of 
the complex solutions. 

Finally, we mention a practical point. If P, Q , and R are polynomials, it is often 
much better to work directly with Eq. (1) than with Eq. (3). This avoids the necessity 
of expressing xQ(x)/P(x) and x 2 R{x)/P{x) as power series. For example, it is more 
convenient to consider the equation 

x(l + x)y" + 2/ + xy = 0 


than to write it in the form 


*y+ *Ly+ * 


v = <1. 


1 + X 1 + X 

which would entail expanding 2x/(l + x) and x 2 /(l + x) in power series. 


PROBLEMS 


In each of Problems 1 through 10: 

(a) Show that the given differential equation has a regular singular point at x = 0. 

(b) Determine the indicial equation, the recurrence relation, and the roots of the indicial 
equation. 

(c) Find the series solution (x > 0) corresponding to the larger root. 

(d) If the roots are unequal and do not differ by an integer, find the series solution 
corresponding to the smaller root also. 


1. 2 xy" + y' + xy = 0 

3. xy" + y = 0 

5. 3 x 2 y" + 2xy' + x 2 y = 0 

7. xy" + (1 — x)y' — y = 0 

9. x 2 y" - x(x + 3)/ + (x + 3)y = 0 

11. The Legendre equation of order a is 

(1 ~x 2 )y' 


2. x 2 y" + xy' + (x 2 — 1) y = 0 
4. xy" + y' — y = 0 
6. x 2 y" + xy' + (x — 2)y = 0 
8. 2 x 2 y" + 3 xy' + (2x 2 — l)y = 0 
10. x 2 y" + (x 2 + \)y = 0 


2 xy' + a(a + l)y = 0. 


The solution of this equation near the ordinary point x = 0 was discussed in Problems 22 
and 23 of Section 5.3. In Example 4 of Section 5.4, it was shown that x = ±1 are regular 
singular points. 

(a) Determine the indicial equation and its roots for the point x = 1. 
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(b) Find a series solution in powers of x — 1 for x — 1 >0. 

Hint: Write l+x = 2 + (x — 1) and x = 1 + (x — 1). Alternatively, make the change of 
variable x — 1 = t and determine a series solution in powers of t. 

12. The Chebyshev equation is 

(1 - x 2 )y" - xy' + a 2 y = 0, 
where a is a constant; see Problem 10 of Section 5.3. 

(a) Show that x = 1 and x = — 1 are regular singular points, and find the exponents at 
each of these singularities. 

(b) Find two solutions about x = 1. 

13. The Laguerre 13 differential equation is 

xy" + (1 - x)y r + Xy = 0. 

(a) Show that x = 0 is a regular singular point. 

(b) Determine the indicial equation, its roots, and the recurrence relation. 

(c) Find one solution (x > 0). Show that if k = m, a positive integer, this solution reduces 
to a polynomial. When properly normalized, this polynomial is known as the Laguerre 
polynomial, L m (x). 

14. The Bessel equation of order zero is 

x 2 /' + xy' + x 2 y = 0. 

(a) Show that x = 0 is a regular singular point. 

(b) Show that the roots of the indicial equation are r% = r 2 = 0. 

(c) Show that one solution for x > 0 is 


Mx) — i+ 

n =1 


(~l) n X 2n 

2 2n (n!) 2 ’ 


(d) Show that the series for / 0 (x) converges for all x. The function J 0 is known as the 
Bessel function of the first kind of order zero. 

15. Referring to Problem 14, use the method of reduction of order to show that the second 
solution of the Bessel equation of order zero contains a logarithmic term. 

Hint: If y 2 (x) = / 0 (x)u(x), then 

f dx 

Find the first term in the series expansion of l/x[/o(x)] 2 . 

16. The Bessel equation of order one is 

x 2 /' + xy' + (x 2 — l)y = 0. 

(a) Show that x = 0 is a regular singular point. 

(b) Show that the roots of the indicial equation are r\ — 1 and r 2 = —1. 


13 Edmond Nicolas Laguerre (1834-1886), a French geometer and analyst, studied the polynomials named 
for him about 1879. He is also known for an algorithm for calculating roots of polynomial equations. 
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(c) Show that one solution for x > 0 is 


x (-irx 2 " 
lW 2 ^ (n + l)!n!2 2 ”' 

(d) Show that the series for Ji (x) converges for all x. The function J\ is known as the 
Bessel function of the first kind of order one. 

(e) Show that it is impossible to determine a second solution of the form 

oo 

x" 1 b n x n , x > 0. 

n =0 


5.6 Series Solutions Near a Regular Singular Point, Part II 

Now let us consider the general problem of determining a solution of the equation 
L[y] = x 2 y" + x[xp(x)]y' + [x 2 q(x)]y = 0, (1) 


where 

oo oo 

xp(x) = ^p n x n , x 2 q(x) = ^2q„x", (2) 

n =0 n —0 

and both series converge in an interval |x| < p for some p > 0. The point x = 0 is a 
regular singular point, and the corresponding Euler equation is 

x 2 y" + poxy' + qoy = 0. (3) 

We seek a solution of Eq. (1) for x > 0 and assume that it has the form 

oo oo 

y = <P(r,x )=v E a n x " = E a » xr+n ’ ( 4 ) 

n =0 n —0 

where ao ^ 0, and we have written y = 0(r,x) to emphasize that 0 depends on r as 
well as x. It follows that 

oo oo 

y' = E + ri)a n x r+n ~ 1 , y" = E (r + n)(r + n- 1 )a n x r+n ~ 2 . 

n =0 n =0 

Then, substituting from Eqs. (2), (4), and (5) in Eq. (1) gives 

aor(r — l)x r + a\(r + l)rx r+1 + • • • + a n (r + n)(r + n — l)x r+n + • • • 

+ (P0 + Pl x + • • • + PnX H + • • 0 

x [aorx r + a\(r + l)x r+1 + • • • + a n (r + ri)x r+n + • • •] 

+ (qo + qi x + • • • + q n x n + ■ ■ ■) 

x ( aox r T ci\x r ^ T • • • T a n x r+n + •••) = 0. 


( 5 ) 
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Multiplying the infinite series together and then collecting terms, we obtain 

aoF(r)x r + [a\F(r + 1) + ao(pir + q\)]x r+1 

+ [a 2 F{r+ 2) + a 0 (p 2 r + q 2 ) + ai\pi{r+ 1) + qi\)x r+2 

H-h {a n F(r +n)+ ao(p n r + q n ) + ai[p n -\{r + 1) + q n - 1 ] 

+ • • • + a n - 1 \p\(j + n — 1) + <7i]} x r+n + • • • = 0, 

or, in a more compact form, 


L[(p](r,x) = aoF(r)x'' 

oo f n —1 ) 

+ E I F (r + n)a n + E [(r + k)p n -k + q n -k\ 1 x r+n = 0, (6) 

n= 1 l fc=0 J 


where 


^00 = r(r - 1) + por + q 0 . (7) 

For Eq. (6) to be satisfied for all x > 0, the coefficient of each power of x must be 
zero. 

Since ao ^ 0, the term involving x r yields the equation F(r) = 0. This equation is 
called the indicial equation; note that it is exactly the equation we would obtain in 
looking for solutions y = x r of the Euler equation (3). Let us denote the roots of 
the indicial equation by r\ and r 2 with r\ > r 2 if the roots are real. If the roots are 
complex, the designation of the roots is immaterial. Only for these values of r can 
we expect to find solutions of Eq. (1) of the form (4). The roots r\ and r 2 are called 
the exponents at the singularity; they determine the qualitative nature of the solution 
in the neighborhood of the singular point. 

Setting the coefficient of x r+n in Eq. (6) equal to zero gives the recurrence relation 


n —1 

F(r + n)a n + ^2 a k [(r + k)p n _ k + q n _ k ] = 0, n > 1. (8) 

k=0 

Equation (8) shows that, in general, a n depends on the value of r and all the pre¬ 
ceding coefficients ciQ,ai ,... ,a n -It also shows that we can successively compute 
ai, d 2 ,..., a n ,... in terms of ao and the coefficients in the series for xp{x) and x 2 g(x), 
provided that F(r + 1), F(r + 2),..., F(r + n), ... are not zero. The only values of r 
for which F(r) = 0 are r — r\ and r = r 2 \ since r\ > 7 * 2 , it follows that r\ + n is not 
equal to r\ or r 2 for n > 1. Consequently, F(r\ + n) / 0 for n > 1. Hence we can 
always determine one solution of Eq. (1) in the form (4), namely, 


yi(x) = x" 1 


00 

1 + (''!>*" ’ 
n =1 


x > 0. 


( 9 ) 


Here we have introduced the notation a n (r 1 ) to indicate that a n has been determined 
from Eq. (8) with r = r\. To specify the arbitrary constant in the solution, we have 
taken ao to be 1. 
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If r 2 is not equal to r \, and r\ — r 2 is not a positive integer, then r 2 + n is not equal 
to r\ for any value of n > 1; hence E(r 2 + w) / 0, and we can also obtain a second 
solution 


yi(x) = x r > 


oo 

1 + E a n (r 2 )x n , 

n=1 


x > 0. 


( 10 ) 


Just as for the series solutions about ordinary points discussed in Section 5.3, the 
series in Eqs. (9) and (10) converge at least in the interval \x\ < p where the series for 
both xp{x) and x 2 q{x) converge. Within their radii of convergence, the power series 

oo oo 

1+5^ a n (ji)x n and 1 + a n( r i)x n define functions that are analytic at x = 0. Thus 

n=1 n—1 

the singular behavior, if there is any, of the solutions y\ and y 2 is due to the factors 
x ri and x ri that multiply these two analytic functions. Next, to obtain real-valued 
solutions for x < 0, we can make the substitution x = — § with § > 0. As we might 
expect from our discussion of the Euler equation, it turns out that we need only 
replace x ri in Eq. (9) and x ri in Eq. (10) by \x\ n and |xp, respectively. Finally, note 
that if r\ and r 2 are complex numbers, then they are necessarily complex conjugates 
and r 2 ^ r\ + N for any positive integer N. Thus, in this case we can always find two 
series solutions of the form (4); however, they are complex-valued functions of x. 
Real-valued solutions can be obtained by taking the real and imaginary parts of 
the complex-valued solutions. The exceptional cases in which r\ = r 2 or r\ — r 2 = N , 
where A is a positive integer, require more discussion and will be considered later in 
this section. 

It is important to realize that r\ and r 2 , the exponents at the singular point, are easy 
to find and that they determine the qualitative behavior of the solutions. To calculate 
r\ and r 2 , it is only necessary to solve the quadratic indicial equation 


r{r - 1) + p 0 r + q 0 = 0, (11) 

whose coefficients are given by 

po = lim xp(x), qo = lim x 2 q{x). (12) 

x^0 x^0 

Note that these are exactly the limits that must be evaluated in order to classify the 
singularity as a regular singular point; thus they have usually been determined at an 
earlier stage of the investigation. 

Further, if v = 0 is a regular singular point of the equation 

P(x)y" + Q(x)y' + R(x)y = 0, (13) 


where the functions P, Q , and R are polynomials, then xp(x) = xQ(x)/P(x) and 
x 2 q(x) = x 2 R(x)/P{x). Thus 


P o 


= lim x 

x^0 


Q(x) 
P(x) ’ 


r 2 R (X) 

q o = imr-. 

x^0 P(X) 


(14) 


Finally, the radii of convergence for the series in Eqs. (9) and (10) are at least equal 
to the distance from the origin to the nearest zero of P other than x = 0 itself. 
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EXAMPLE 

1 


Discuss the nature of the solutions of the equation 

2x(l + x)y" + (3 + x)y' — xy = 0 

near the singular points. 

This equation is of the form (13) with P{x) = 2x(l + x), Q{x ) = 3 + x, and R(x) = —x. The 
points x = 0 and x = — 1 are the only singular points. The point x = 0 is a regular singular 
point, since 


r GW r 3+x 

limx-= limx--- 

x^O P(x) x^O 2x(l+x) 


3 


2’ 




Further, from Eq. (14), p 0 = | and q 0 = 0. Thus the indicial equation is r(r — 1) + |r = 0, and 
the roots are r\ = 0, r 2 = — \. Since these roots are not equal and do not differ by an integer, 
there are two solutions of the form 


oo 

y\{x) = 1 + y^a„(0)x" 

n =1 


and 


y 2 (x) = |X|“ 1/2 


i + 

n =1 


for 0 < |x| < p. A lower bound for the radius of convergence of each series is 1, the distance 
from x = 0 to x = — 1, the other zero of P(x). Note that the solution yi is bounded as x 0, 
indeed is analytic there, and that the second solution y 2 is unbounded as x 0. 

The point x = —1 is also a regular singular point, since 


r / , ^QW r (X + 1) (3 + X) 

lim (x + 1)-= lim ---= —1, 

x-»-i v P(x) x->~i 2x(l+x) 


r / ,^ 2 ^) r (x + l)(-x) 

lim (x + 1) -= lim - 

X-+-1 P(x) x->-l 2x(l+x) 


= 0 . 


In this case/7 0 = — l,qo = 0, so the indicial equation is r(r — 1) — r = 0. The roots of the indicial 
equation are r\ = 2 and r 2 = 0. Corresponding to the larger root there is a solution of the form 


y\(x) = (x + 1) 2 


oo 

1 + y (2) (x + l) n 

n =1 


The series converges at least for |x + 1| < 1, and yi is an analytic function there. Since the two 
roots differ by a positive integer, there may or may not be a second solution of the form 


y 2 (x) = 1 + ^a„( 0)(x + 1)”. 

n =1 

We cannot say more without further analysis. 

Observe that no complicated calculations were required to discover the information about 
the solutions presented in this example. All that was needed was to evaluate a few limits and 
solve two quadratic equations. 


We now consider the cases in which the roots of the indicial equation are equal or 
differ by a positive integer, r\—r 2 = N. As we have shown earlier, there is always one 
solution of the form (9) corresponding to the larger root r\ of the indicial equation. 
By analogy with the Euler equation, we might expect that if r\ —ri, then the second 
solution contains a logarithmic term. This may also be true if the roots differ by an 
integer. 













292 


Chapter 5. Series Solutions of Second Order Linear Equations 


Equal Roots. The method of finding the second solution is essentially the same as the 
one we used in finding the second solution of the Euler equation (see Section 5.4) 
when the roots of the indicial equation were equal. We consider r to be a continuous 
variable and determine a n as a function of r by solving the recurrence relation (8). 
For this choice of a n (r) for n > 1, the terms in Eq. (6) involving x r+1 , x r+2 , x r+3 ,... all 
have coefficients equal to zero. Therefore, Eq. (6) reduces to 

L[<p](r,x) = a 0 F(r)x r = a 0 (r - n) 2 x r , (15) 


since r\ is a repeated root of F(r). Setting r = r\ in Eq. (15), we find that 
L[0](ri,x) = 0; hence, as we already know, y\(x) given by Eq. (9) is one solution 
of Eq. (1). But more important, it also follows from Eq. (15), just as for the Euler 
equation, that 


L 


30 

dr 


(ri,x) = a 0 — [x r (r - n) ] 
dr 


r=n 


= aol( r ~ ri) 2 x r Inx + 2(r — r\)x r ] 
Hence, a second solution of Eq. (1) is 
# (r 9 x) 


= 0 . 


r=r\ 


(16) 


yi(x) = 


dr 


^ 1 
II 

u 

dr 

r=r i 1 

1 L 


= (x ri \nx) 


a 0 + y ^a n (r)x n 

n =1 
oo 

fl 0 + 


r=n 


n =1 


+ X r ^ a 'n(n)x n 


n =1 


= yi{x)\nx + x ri y2 i a' n (j\)x n , x > 0, 


(17) 


n =1 


where a! n (r{) denotes da n /dr evaluated at r = r\. 

Although Eq. (17) provides an explicit expression for a second solution y 2 (x ), it 
may turn out that it is difficult to determine a n (r) as a function of r from the recur¬ 
rence relation (8) and then to differentiate the resulting expression with respect to r. 
An alternative is simply to assume that y has the form of Eq. (17). That is, assume that 


oo 

y = y 1 (x)\nx + x ri ^2^nX n , x > 0, (18) 

n =1 

where y\(x) has already been found. The coefficients b n are calculated, as usual, by 
substituting into the differential equation, collecting terms, and setting the coeffi¬ 
cient of each power of % equal to zero. A third possibility is to use the method of 
reduction of order to find y 2 (x) once y\(x) is known. 


Roots r\ and r 2 Differing by an Integer N. For this case the derivation of the second solu¬ 
tion is considerably more complicated and will not be given here. The form of this 
solution is stated in Eq. (24) in the following theorem. The coefficients c n (j 2 ) in 
Eq. (24) are given by 

d 

c n (r 2 ) = -r\(r - r 2 )a n (r)] 


r=r 2 


n = 1 , 2 ,..., 


(19) 
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Theorem 5.6.1 


where a n (r) is determined from the recurrence relation ( 8 ) with = 1. Further, the 
coefficient a in Eq. (24) is 

a = lim(r — r 2 )a^(r). ( 20 ) 

r^r 2 

If a^{r 2 ) is finite, then a = 0 and there is no logarithmic term in y 2 . A full derivation 
of formulas (19) and (20) may be found in Coddington (Chapter 4). 

In practice, the best way to determine whether a is zero in the second solution 
is simply to try to compute the a n corresponding to the root r 2 and to see whether it is 
possible to determine a^{r 2 ). If so, there is no further problem. If not, we must use 
the form (24) with a 7 ^ 0. 

When n — r 2 = N , there are again three ways to find a second solution. First, we 
can calculate a and c n (r 2 ) directly by substituting the expression (24) for y in Eq. (1). 
Second, we can calculate c n (r 2 ) and a of Eq. (24) using the formulas (19) and (20). 
If this is the planned procedure, then in calculating the solution corresponding to 
r = n, be sure to obtain the general formula for a n (r) rather than just a n (r 1 ). The 
third alternative is to use the method of reduction of order. 

The following theorem summarizes the results that we have obtained in this section. 


Consider the differential equation (1) 

x 2 y" + x[xp(x)]y' + [x 2 q(x)]y = 0 , 

where x = 0 is a regular singular point. Then xp{x) and x 2 q{x) are analytic at x = 0 
with convergent power series expansions 

00 00 

xp(x) = y jhl x n , x 2 q(x) = q n x n 

n =0 n —0 

for \x\ < p, where p > 0 is the minimum of the radii of convergence of the power 
series for xp{x) and x 2 q{x). Let r\ and r 2 be the roots of the indicial equation 


F(r) = r(r - 1) + p 0 r + q 0 = 0, 


with r\ > r 2 if r\ and r 2 are real. Then in either the interval — p < x < 0 or the interval 
0 < x < p, there exists a solution of the form 


yi(x) = I*r 


00 

1 + y^a n (r\)x n , 

n =1 


( 21 ) 


where the a n (ji) are given by the recurrence relation ( 8 ) with = 1 and r = r\. 

If r\ — r 2 is not zero or a positive integer, then in either the interval — p < x < 0 
or the interval 0 < x < p, there exists a second solution of the form 

00 

1 + 

n =1 


y 2 (x) = \x\ n 


( 22 ) 
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PROBLEMS 


The a n (r 2 ) are also determined by the recurrence relation (8) with ao = 1 and 
r = r 2 . The power series in Eqs. (21) and (22) converge at least for |x| < p. 

If n = r 2 , then the second solution is 


oo 

yiix) = yi(x) In \x\ + \x\ n 'Y^ J b n (ri)x n . 

n =1 


If r\ — r 2 = N, a positive integer, then 


y 2 (x) = ay\(x) In \x\ + \x\ ri 


1 + E c n (r 2) x " 

n —1 


(23) 


(24) 


The coefficients a n (ri), b n (r{), and c n (r 2 ) and the constant a can be determined by 
substituting the form of the series solutions for y in Eq. (1). The constant a may 
turn out to be zero, in which case there is no logarithmic term in the solution (24). 
Each of the series in Eqs. (23) and (24) converges at least for \x\ < p and defines a 
function that is analytic in some neighborhood of x = 0. 

In all three cases, the two solutions yi(x) and y 2 (x) form a fundamental set of 
solutions of the given differential equation. 


In each of Problems 1 through 12: 

(a) Find all the regular singular points of the given differential equation. 

(b) Determine the indicial equation and the exponents at the singularity for each regular 


singular point. 

1. xy" + 2 xy' + 6 e x y = 0 
3. x(x - 1 )y" + 6x 2 y' + 3y = 0 
5. x 2 y" + 3(sinx))/ - 2y = 0 
7. x 2 y" + 1(jc + sinx)/ + y = 0 
9. x 2 (l - x)y" — (1 + x)y' + 2xy = 0 
11. (4 — x 2 )y" + 2 xy' + 3y = 0 


2. x 2 y" — x(2 + x)y' + (2 + x 2 )y = 0 
4. y" + 4xy' + 6y = 0 
6 . 2x(x + 2 )y" + y — xy = 0 
8. (x + 1 ) 2 y" + 3(x 2 - l)y' + 3y = 0 
10. (x — 2) 2 (x + 2 )y" + 2 xy' + 3(x — 2)y = 0 
12. x(x + 3) 2 y" — 2(x + 3 )y f — xy = 0 


In each of Problems 13 through 17: 

(a) Show that x = 0 is a regular singular point of the given differential equation. 

(b) Find the exponents at the singular point x = 0. 

(c) Find the first three nonzero terms in each of two solutions (not multiples of each other) 
about x = 0. 


13. xy" + y - y = 0 

14. xy" + 2 xy' + 6 e x y = 0; see Problem 1 

15. x(x - l)y" + 6x 2 y' + 3y = 0; see Problem 3 

16. xy" + y = 0 

17. x 2 y" + (sinx)y / — (cosx)y = 0 

18. (a) Show that 

(lnx)y"+l/+y = 0 


has a regular singular point at x = 1. 
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(b) Determine the roots of the indicial equation at x = 1. 

oo 

(c) Determine the first three nonzero terms in the series J2 a n( x ~ l) r+n corresponding 

to the larger root. Take x — 1 > 0. n=0 

(d) What would you expect the radius of convergence of the series to be? 


19. In several problems in mathematical physics, it is necessary to study the differential 
equation 


x(l - x)y" + [y - (1 + a + /3)x]y' - afiy = 0, 


(i) 


where a , p, and y are constants. This equation is known as the hypergeometric equation. 

(a) Show that x = 0 is a regular singular point and that the roots of the indicial equation 
are 0 and 1 — y. 

(b) Show that x = 1 is a regular singular point and that the roots of the indicial equation 
are 0 and y — a — p. 

(c) Assuming that 1 — y is not a positive integer, show that, in the neighborhood of x = 0, 
one solution of Eq. (i) is 


yi(x) = 1 + 


aft a(oi + 1)P(P + 1) 2 
y 7 !! y(y + 1)2! * 


What would you expect the radius of convergence of this series to be? 

(d) Assuming that 1 — y is not an integer or zero, show that a second solution for 
0 < x < 1 is 


y 2 (x) =x 1 y 



(a -y + l)(P - y + 1) 
(2 - y)ll X 


(« -y + l)(a -y + 2)(0 -y + \)(fi - y + 2) 2 
(2 — y)(3 — y)2\ 

(e) Show that the point at infinity is a regular singular point and that the roots of the 
indicial equation are a and ft. See Problem 43 of Section 5.4. 

20. Consider the differential equation 

x 3 y" + axy' + f$y = 0, 

where a and /3 are real constants and a/0. 

(a) Show that x = 0 is an irregular singular point. 

oo 

(b) By attempting to determine a solution of the form J2 a n x r+n , show that the indicial 

n =0 

equation for r is linear and that, consequently, there is only one formal solution of the 
assumed form. 

(c) Show that if p/a = — 1,0,1,2,..., then the formal series solution terminates and there¬ 
fore is an actual solution. For other values of p/a, show that the formal series solution has 
a zero radius of convergence and so does not represent an actual solution in any interval. 

21. Consider the differential equation 



where a/0 and p ^ 0 are real numbers, and 5 and t are positive integers that for the 
moment are arbitrary. 
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(a) Show that if s > 1 or t > 2, then the point x = 0 is an irregular singular point. 

(b) Try to find a solution of Eq. (i) of the form 

oo 

y = y^ a n x r+n , x > 0. (ii) 

n =o 

Show that its = 2 and t = 2, then there is only one possible value of r for which there is a 
formal solution of Eq. (i) of the form (ii). 

(c) Show that if s = 1 and t = 3, then there are no solutions of Eq. (i) of the form (ii). 

(d) Show that the maximum values of s and t for which the indicial equation is quadratic in 
r [and hence we can hope to find two solutions of the form (ii)] are s = 1 and t — 2. These 
are precisely the conditions that distinguish a “weak singularity,” or a regular singular 
point, from an irregular singular point, as we defined them in Section 5.4. 

As a note of caution, we point out that although it is sometimes possible to obtain a formal 
series solution of the form (ii) at an irregular singular point, the series may not have a 
positive radius of convergence. See Problem 20 for an example. 


5.7 Bessel's Equation 


In this section we illustrate the discussion in Section 5.6 by considering three special 
cases of Bessel’s 14 equation, 

x 2 y" + xy' + (x 2 - v 2 )y = 0, (1) 


where v is a constant. It is easy to show that x = 0 is a regular singular point of Eq. (1). 
We have 


r Q(x) l 

Po = hmx -= limx- 

x^O P(x) x^O X 


qo 


2 R(x) 
lim x - 

x^O P(x) 


lim x 2 - 

x^O 


Thus the indicial equation is 

F{r) = r(r - 1) + p 0 r + qo = r(r - 1) + r - v 2 = r 2 - v 2 = 0, 

with the roots r = d=v. We will consider the three cases v = 0, v = and v = 1 for 
the interval x > 0. 


Bessel Equation of Order Zero. In this case v = 0, so Eq. (1) reduces to 

L[y] = x 2 y" + xy' + x 2 y = 0, 


( 2 ) 


14 Friedrich Wilhelm Bessel (1784-1846) left school at the age of 14 to embark on a career in the import- 
export business but soon became interested in astronomy and mathematics. He was appointed director 
of the observatory at Konigsberg in 1810 and held this position until his death. His study of planetary 
perturbations led him in 1824 to make the first systematic analysis of the solutions, known as Bessel 
functions, of Eq. (1). He is also famous for making, in 1838, the first accurate determination of the distance 
from the earth to a star. 
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and the roots of the indicial equation are equal: r\ = r 2 = 0. Substituting 

oo 

y = <p(r,x) = aox r + ^ a n x r+n (3) 

n =1 


in Eq. (2), we obtain 


oo oo 

L[<p](r,x) = ^2,a n [(r + n)(r + n - 1) + (r + n)]x r+n + a n x r+n+1 

n =0 n =0 

= a 0 [r(r - 1) + r]x r + m [(r + 1 )r + (r + 1)K +1 

OO 

+ ^ {«„[(r + n)(r + n - 1) + (r + n)] + a n - 2 ) x r+n = 0. (4) 

n—2 

As we have already noted, the roots of the indicial equation F(r) = r(r — 1) + r = 0 
are r\ = 0 and r 2 = 0. The recurrence relation is 

, , an-iir) a n - 2 (r) 

a n (r) = ---=- n > 2. (5) 

(r + n)(r + n — 1) + (r + n) (r + n) 2 

To determine we set r equal to 0. Then, from Eq. (4), it follows that for 

the coefficient of x r+1 to be zero we must choose a\ = 0. Hence, from Eq. (5), 
a 3 = as = a-/ = • • • = 0. Further, 

0#i(O) = -a n - 2 (0)/n 2 , n = 2,4,6,8,..., 

or, letting = 2m, we obtain 


02m (0) = — 0 2 m- 2 (O)/ (2m) 2 , m = 1,2,3,... . 


Thus 


0 2 (O) = 



04 ( 0 ) = 


00 

2 4 2 2 ’ 


06 ( 0 ) = 


0o 

2 6 (3 • 2) 2 ’ 


and, in general, 


02m (0) = 


( —l) m 0Q 
2 2m (rn!) 2 ’ 


m = 1,2,3,.... 


( 6 ) 


Hence 


yi(x) = a 0 


oo 

1 + E 


m=l 


(_l)m x 2m 

2 2m (m!) 2 


x > 0. 


( 7 ) 


The function in brackets is known as the Bessel function of the first kind of order 
zero and is denoted by Jo(x). It follows from Theorem 5.6.1 that the series converges 
for all x and that Jo is analytic at x = 0. Some of the important properties of Jo are 
discussed in the problems. Figure 5.7.1 shows the graphs of y = /o(x) and some of 
the partial sums of the series (7). 
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y 

2 


1 


-1 


n = 4 n - 8 n = 12 n = 16 n = 20 


2 4 6 8 10 x 

y = J 0 W 

n = 2 7i = 6 7i = 10 71 = 14 71 = 18 


FIGURE 5.7.1 Polynomial approximations to Jo(x), the Bessel function of the first kind 
of order zero. The value of n is the degree of the approximating polynomial. 


To determine we will calculate 15 a r n {Q). First we note from the coefficient of 
x r+1 in Eq. (4) that (r + l) 2 0 i(r) = 0. Thus a\(r) = 0 for all r near r = 0. So not 
only does <?i(0) = 0 but also a\ (0) = 0. From the recurrence relation (5) it fol¬ 
lows that 03 ( 0 ) = a' 5 (0 ) = • • • = a' 2n+1 i0) = • • • = 0; hence we need only compute 
a' 2m (0),m = 1,2,3, _From Eq. (5) we have 

aim(r) = ~a 2m - 2 (r)/(r + 2m) 2 , m = 1,2,3,.... 


By solving this recurrence relation, we obtain 


ci2 (r) = 


ap 

(r + 2) 2 ’ 


a 4 (r) = 


dp 

(r + 2) 2 (r + 4) 2 ’ 


and, in general, 


d 2 m(r) = 


(r + 2) 2 • • • (r + 2m) 2 ’ 


m > 3. 


( 8 ) 


The computation of a' 2m (r) can be carried out most conveniently by noting that if 
fix) = (x - )^(x - a 2 )^(x - a 3 / 3 • • • (x - a n )^ n , 


and if % is not equal to cq, c* 2 ,..., a w , then 

fix) fr [ ft | [ ft 

fix) x — a i x — a 2 x — a n 

Applying this result to 02 m (/) from Eq. (8), we find that 

gy2=- 2 tJ-+ j_+...+ 1 

a 2m (r) \ r + 2 r + 4 r + 2m 


15 Problem 10 outlines an alternative procedure, in which we simply substitute the form (23) of Section 5.6 
in Eq. (2) and then determine the b n . 
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and setting r equal to 0 , we obtain 
<( 0 ) = -2 


1 1 1 
2 + 4 + '" + 2m 


@2 m ( 0 ) • 


Substituting for < 22 m( 0 ) from Eq. ( 6 ), and letting 


we obtain, finally, 


H n 


a 2m (0) — 


d 1 1 1 

1 + - + -H-1-, 

2 3 m 


(-l) m ^o 
2 2m ( m!) 2 ’ 


ra = 1,2,3,.... 


(9) 


The second solution of the Bessel equation of order zero is found by setting ao = 1 
and substituting for yi(x) and a' 2m (0) = 62 m(0) in Eq. (23) of Section 5.6. We obtain 


00 

yi(x) = J 0 (x) In x + ^2 

m=1 


(-D m+1 // m 

2 2m (ml) 2 


x 2m , 


x > 0 . 


( 10 ) 


Instead of 3 ^ 2 , the second solution is usually taken to be a certain linear combination 
of Jo and y?. It is known as the Bessel function of the second kind of order zero 
and is denoted by Y {l . Following Copson (Chapter 12), we define 16 

Y 0 (x) = -\y 2 (x) + (Y~ In 2)/ 0 (x)]. (11) 

71 


Here y is a constant known as the Euler-Mascheroni 17 constant; it is defined by the 
equation 

y = lim (H n - In n) = 0.5772. (12) 


Substituting for y 2 (x) in Eq. (11), we obtain 


Y 0 (x) = - 

71 


oo 

(y + i n 2 + Y. 


(-1 ) m+l H, 


m=l 


2 2m (m!) : 


m x 2m 


x > 0 . 


(13) 


The general solution of the Bessel equation of order zero for x > 0 is 


y = c\Jq(x) + c 2 Y 0 (x). 


Note that Jo(x) 1 as x 0 and that Yq(x) has a logarithmic singularity at x = 0; 
that is, Y() (x) behaves as (2/n) lnx when x 0 through positive values. Thus, if we 
are interested in solutions of Bessel’s equation of order zero that are finite at the 
origin, which is often the case, we must discard Y {) . The graphs of the functions Jq and 
Yo are shown in Figure 5.7.2. 


16 Other authors use other definitions for Yo - The present choice for Yo is also known as the Weber function, 
after Heinrich Weber (1842-1913), who taught at several German universities. 

17 The Euler-Mascheroni constant first appeared in 1734 in a paper by Euler. Lorenzo Mascheroni 
(1750-1800) was an Italian priest and professor at the University of Pavia. He correctly calculated the first 
19 decimal places of y in 1790. 
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FIGURE 5.7.2 The Bessel functions of order zero: J 0 and Y 0 . 


It is interesting to note from Figure 5.7.2 that for x large, both /q(x) and Yq(x) are 
oscillatory. Such a behavior might be anticipated from the original equation; indeed 
it is true for the solutions of the Bessel equation of order v. If we divide Eq. (1) by 
x 2 , we obtain 

For x very large, it is reasonable to conjecture that the terms (1/x)/ and (v 2 /x 2 )y are 
small and hence can be neglected. If this is true, then the Bessel equation of order v 
can be approximated by 

y"+y = o. 


The solutions of this equation are sin x and cos x; thus we might anticipate that the 
solutions of Bessel’s equation for large x are similar to linear combinations of sin x 
and cos x. This is correct insofar as the Bessel functions are oscillatory; however, it is 
only partly correct. For x large the functions Jq and Yo also decay as x increases; thus 
the equation y" + y = 0 does not provide an adequate approximation to the Bessel 
equation for large x, and a more delicate analysis is required. In fact, it is possible to 
show that 


and that 



(14) 


(15) 


These asymptotic approximations, as x -> oo, are actually very good. For example, 
Figure 5.7.3 shows that the asymptotic approximation (14) to /o(x) is reasonably 
accurate for all x > 1. Thus to approximate /o(x) over the entire range from zero to 
infinity, you can use two or three terms of the series (7) for x < 1 and the asymptotic 
approximation (14) forx > 1. 
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y 

2 


1 



1/2 

Asymptotic approximation: y = (2 Inx) 


cos(x - n! 4) 


y = J 0 (x) 



X 


-1 - 

FIGURE 5.7.3 Asymptotic approximation to / 0 (x). 


Bessel Equation of Order One-Half. This case illustrates the situation in which the roots 
of the indicial equation differ by a positive integer but there is no logarithmic term 
in the second solution. Setting v = \ in Eq. (1) gives 

L[y] = x 2 y" + xyf + (x 2 -\)y = 0. (16) 

When we substitute the series (3) for y = </>(r,x), we obtain 

oo oo 

L[<p](r,x) = ^ [(r + n)(r + n - 1) + (r + n) - a n x r+n + ^ a n x r+n+1 

n= 0 n =0 

= (r 2 - \) a 0 x r + [(r + l) 2 - i] a x x r+1 

OO 

+ {[(^ + ft) 2 — W tin + Cln-l} X r+n = 0- (17) 

n =2 


The roots of the indicial equation are r\ = r 2 = — \ \ hence the roots differ by an 
integer. The recurrence relation is 

[0 + n) 2 -\]a n = —a n - 2 , n> 2. (18) 

Corresponding to the larger root r\ — we find, from the coefficient of x r+1 in 
Eq. (17), that a\ — 0. Hence, from Eq. (18), = as = • • • = ft 2 «+i = • • • = 0. Fur¬ 

ther, for r = 1, 


tin —2 

/?(/? +1) ’ 


w = 2,4,6..., 


or, letting n = 2m, we obtain 


_ ft2m—2 

2m 2m (2m + 1) ’ 

By solving this recurrence relation, we find that 


m = 1,2,3,.... 


ft2 = - 


fto 

3!’ 
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and, in general, 

( l) m fl 0 

(2m+ 1)!’ 

Hence, taking a 0 = 1, we obtain 


^2 m — 


yi(x) =x 1/2 


i + E 


m=1 


(— l) m x 2m 

(2m+ 1)! 


= X 


ra = 1,2,3,.... 


00 z' l\m v 2m+l 

—1/2 V--U * 


E 

m =0 


(2m+ 1)! ’ 


x > 0. 


(19) 


The second power series in Eq. (19) is precisely the Taylor series for sin x; hence one 
solution of the Bessel equation of order one-half is x~ 1/2 sin*. The Bessel function 
of the first kind of order one-half,/i /2 , is defined as (2/7r) 1/2 yi. Thus 

/ 2 \ 1/2 

J l/ 2 (x) = I — I sinx, x > 0. (20) 


Corresponding to the root r 2 = — it is possible that we may have difficulty in 
computing a\ since N = r\ — r 2 = 1. However, from Eq. (17) for r = — the coeffi¬ 
cients of x r and x r+1 are both zero regardless of the choice of ao and a\. Hence ao 
and a\ can be chosen arbitrarily. From the recurrence relation (18), we obtain a set 
of even-numbered coefficients corresponding to ao and a set of odd-numbered coef¬ 
ficients corresponding to a\. Thus no logarithmic term is needed to obtain a second 
solution in this case. It is left as an exercise to show that, for r = — 


_ (-D^o _ (-l)^i 

tt2n ~ (2/i)! ’ U2n+1 ~ (2/i + l)!’ 


n = 1,2,.... 


Hence 


y 2 (x) = x~ 1/2 



(~l) n x 2n 

any. 


00 

+ a i E 

n=0 


(—l) n x 2n+1 

On + 1)! 


cosx sinx 

= ^>0. 


( 21 ) 


The constant 01 simply introduces a multiple of yi(x). The second solution of the 
Bessel equation of order one-half is usually taken to be the solution for which 
a 0 = (2/7t) 1/2 and a\ = 0. It is denoted by /_i/ 2 . Then 


/ 2 \ 1/2 

/_i /2 (x) =1 — I cosx, x > 0. (22) 


The general solution of Eq. (16) is y = ci/i/ 2 (x) + c 2 /_i /2 (x). 

By comparing Eqs. (20) and (22) with Eqs. (14) and (15), we see that, except for a 
phase shift of 7 t/ 4, the functions J- 1/2 and /i/ 2 resemble Jo and Yo, respectively, for 
large x. The graphs of /i /2 and J- 1/2 are shown in Figure 5.7.4. 


Bessel Equation of Order One. This case illustrates the situation in which the roots of 
the indicial equation differ by a positive integer and the second solution involves a 
logarithmic term. Setting v = 1 in Eq. (1) gives 

L[y] = x 2 y" + xy + (x 2 - 1)y = 0. 


(23) 
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If we substitute the series (3) for y = 0(r,x) and collect terms as in the preceding 
cases, we obtain 

L[0](r,x) = a 0 (r 2 - l)x r + a\[(r + l) 2 l]x r+1 

oo 

+ y ] | [(r + ft) 2 — l] ^ | x r+n = 0. (24) 

n—2 

The roots of the indicial equation are r\ — 1 and r 2 — — 1. The recurrence relation is 
[(r + n ) 2 - lR(r) = -fl w _ 2 (r), ft > 2. (25) 


Corresponding to the larger root r = 1, the recurrence relation becomes 




tin—2 

(n + 2)ft ’ 


ft = 2,3,4,.... 


We also find, from the coefficient of x r+1 in Eq. (24), that a\ = 0; hence, from the 
recurrence relation, a 2 — a$ = • • • = 0. For even values of ft, let n = 2m; then 


@2 m — 


^2m—2 


^2m—2 


(2m + 2)(2ftz) 2 2 (m + 1 )m ’ 

By solving this recurrence relation, we obtain 

(-l) m tfo 


m = 1,2,3,.... 


&2m — 


2 2m (m + l)!ftz! ’ 


m = 1,2,3,. 


(26) 


The Bessel function of the first kind of order one, denoted by /i, is obtained by 
choosing = 1/2. Hence 


oo 

X x—> 

= 2 E 

m=0 


(_l)m x 2m 

2 2m (m + l)!fti! 


(27) 


The series converges absolutely for all jc, so the function J\ is analytic everywhere. 

In determining a second solution of Bessel’s equation of order one, we illustrate 
the method of direct substitution. The calculation of the general term in Eq. (28) 
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below is rather complicated, but the first few coefficients can be found fairly easily. 
According to Theorem 5.6.1, we assume that 


y 2 (x) = aJ\(x) lnx + x 


1 + y ' c n x n 

n =1 


x > 0. 


(28) 


Computing y' 2 (x),y f 2 (x), substituting in Eq. (23), and making use of the fact that J\ is 
a solution of Eq. (23), we obtain 


oo oo 

2 axJ[{x) + [( n — 1 )(n — 2 )c n + (n — 1 )c n — c n \x n ~ l + ^ c n x n+1 = 0, (29) 

n —0 n —0 

where co = 1. Substituting for /i(x) from Eq. (27), shifting the indices of summation 
in the two series, and carrying out several steps of algebra, we arrive at 


oo 

—Cl + [0 • C 2 + Co]x + ^2 [(^ 2 — l)Cz+l + C n -l\x n 

n—2 


= —a 


+ E 


m=l 


(—l) m (2m + l)x 2m+1 
2 2m (m +1)! m! 


. (30) 


From Eq. (30) we observe first that c\ — 0, and a — — Co = — 1. Further, since there 
are only odd powers of v on the right, the coefficient of each even power of v on the 
left must be zero. Thus, since c\ = 0, we have c 3 = C5 = • • • = 0. Corresponding to 
the odd powers of jc, we obtain the following recurrence relation [let n = 2m + 1 
in the series on the left side of Eq. (30)]: 

ivo 1 1 \2 n , (—l) m (2ra + l) 

[(2m+ 1) -l]c 2m+2 +c 2m = 22m(w + 1) , mr m = 1,2,3,.... (31) 

When we set m = 1 in Eq. (31), we obtain 

(3 2 - 1)C4 + C 2 = (—1)3/(2 2 • 2!). 


Notice that C2 can be selected arbitrarily , and then this equation determines C4. Also 
notice that in the equation for the coefficient of x, c 2 appeared multiplied by 0, and 
that equation was used to determine a. That c 2 is arbitrary is not surprising, since C2 


is the coefficient of v in the expression v 1 


00 

1 + E c nX n 


n =1 


. Consequently, C2 simply 


generates a multiple of/1, and y 2 is determined only up to an additive multiple of J\. 
In accordance with the usual practice, we choose C2 = 1/2 2 . Then we obtain 


-1 

[-+11 

-1 

r(i+i)+ii 

2 4 -2 

L2 J 

“ E2! 

Lv v \ 




It is possible to show that the solution of the recurrence relation (31) is 

(-ir +i (g m +// m -i) 

2 2m ml(m — 1 )! 


^2 m — 


m = 1 , 2 ,... 
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PROBLEMS 


with the understanding that H Q = 0. Thus 


y 2 (x) = J i(x) lnx + - 1 
x 


y. ( — + H m -\) ^ 2m 

— 2 2m m\(m — 1)! * 

m=1 


x > 0. (32) 


The calculation of y 2 (x) using the alternative procedure [see Eqs. (19) and (20) 
of Section 5.6] in which we determine the c n (r 2 ) is slightly easier. In particular, the 
latter procedure yields the general formula for C 2 m without the necessity of solving a 
recurrence relation of the form (31) (see Problem 11). In this regard, you may also 
wish to compare the calculations of the second solution of Bessel’s equation of order 
zero in the text and in Problem 10. 

The second solution of Eq. (23), the Bessel function of the second kind of order 
one, Y \, is usually taken to be a certain linear combination of J\ and y 2 . Following 
Copson (Chapter 12), Y\ is defined as 

Y\ (x) = -\-y 2 (x) + (y- ln2)/i(x)], (33) 

7T 

where y is defined in Eq. (12). The general solution of Eq. (23) for x > 0 is 


y = ciJiix) + c 2 Yi(x). 

Notice that although J\ is analytic at x = 0, the second solution Y\ becomes 
unbounded in the same manner as 1/x as x ->► 0. The graphs of J\ and Y\ are shown 
in Figure 5.7.5. 


X 

1 


0.5 


-0.5 


y = J l [x) 

y = Yjte) 


2 4 6 8 10 12 14 x 


FIGURE 5.7.5 The Bessel functions J\ and Y\. 


In each of Problems 1 through 4, show that the given differential equation has a regular singular 
point at x = 0, and determine two solutions for x > 0. 

1. x 2 y" + 2xy ; + xy = 0 2. x 2 y" + 3x/ + (1 + x)y = 0 

3. x 2 y" + xy' + 2xy = 0 4. x 2 y" + 4xy' + (2 + x)y = 0 

5. Find two solutions (not multiples of each other) of the Bessel equation of order | 

x 2 y" + xy' + (x 2 — |) y = 0, x > 0. 
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6. Show that the Bessel equation of order one-half 

x 2 y" + xy' + (x 2 — \) y = 0, x > 0 
can be reduced to the equation 

v" + u = 0 

by the change of dependent variable y = x~ 1/2 v(x). From this, conclude that 
yi(x) =x -1/2 cosx and y 2 (x) =x -1/2 sinx are solutions of the Bessel equation of order 
one-half. 

7. Show directly that the series for / 0 (x), Eq. (7), converges absolutely for all x. 

8. Show directly that the series for /i(x), Eq. (27), converges absolutely for all x and that 
/'(x) = J\ (x). 

9. Consider the Bessel equation of order v 

x 2 y" + xy' + (x 2 - v 2 )y = 0, x > 0, 
where v is real and positive. 

(a) Show that x = 0 is a regular singular point and that the roots of the indicial equation 
are v and — v. 

(b) Corresponding to the larger root v, show that one solution is 

^ (~l) m /X\2m“ 

m!(l + v) • • • (m + v) V2/ 


(c) If 2v is not an integer, show that a second solution is 


y 2 (x) = x v 


U 1 ( 

r f, 1 /• 

V \ 4 

1 

t-H 

H 

2/ 2!(1 — v)(2 — v) V: 

2/ 


oo 


+ E 


(—l) m 

m\{ 1 — v) • • • (m — v) 



Note that yi(x) 0 as x 0, and that y 2 (x) is unbounded as x 0. 

(d) Verify by direct methods that the power series in the expressions for yi(x) and y 2 (x) 
converge absolutely for all x. Also verify that y 2 is a solution, provided only that v is not 
an integer. 

10. In this section we showed that one solution of Bessel’s equation of order zero 

L[y] = x 2 y" + x/ + x 2 y = 0 


is Jo, where / 0 (x) is given by Eq. (7) with a 0 = 1. According to Theorem 5.6.1, a second 
solution has the form (x > 0) 


(a) Show that 


oo 

y 2 (x) = J 0 (x) lnx + ^ b n x n . 

n =1 


oo oo oo 

L[y 2 \{x) = ^2 n ( n — 1 )b n x n + ^2 n bnX n + ^6„x" +2 + 2 xJ f 0 (x). 

n=2 n =1 n =1 


(i) 
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(b) Substituting the series representation for / 0 (x) in Eq. (i), show that 


oo 

b\x + 2 2 b 2 x 2 + ( n 2 bn + b n - 2 )x n 

n =3 


0 y, (—l) n 2nx 2n 
A 2 2 "(n!) 2 

n =1 


(ii) 


(c) Note that only even powers of x appear on the right side of Eq. (ii). Show that 
b\ = b 2 — b$ — • • • = 0, b 2 — 1/2 2 (1!) 2 , and that 

C 2n) 2 b 2n + b 2n _ 2 = -2(-l) n (2n)/2 2n (n\) 2 , n = 2,3,4,.... 

Deduce that 

bA = ~ l ^( 1 + ^) and ft 6 = 2^( 1 + Ul)- 

The general solution of the recurrence relation is b 2n = (—l) n+1 H n /2 2n (n\) 2 . Substituting 
for b n in the expression for y 2 (x), we obtain the solution given in Eq. (10). 

11. Find a second solution of Bessel’s equation of order one by computing the c n (r 2 ) and a 
of Eq. (24) of Section 5.6 according to the formulas (19) and (20) of that section. Some 
guidelines along the way of this calculation are the following. First, use Eq. (24) of this 
section to show that a\(—l) and a[(— 1) are 0. Then show that ci(—1) = 0 and, from the 
recurrence relation, that c n (— 1) = 0 for n = 3,5,_Finally, use Eq. (25) to show that 

/ \ _ <*0 / x _ Oo 

tt2{r) ~ _ (r + l)(r + 3) ’ a4{r) ~ (r + l)(r + 3)(r + 3)(r + 5) 

and that 

_ (~l) m ^o _ 

aim (r + 1) • • • (r + 2m — l)(r + 3) • • • (r + 2m + 1) ’ m ~ 

Then show that 


c 2 m(-l) = (~l) m+1 (H m + H m -\)/2 2m m\(jn - 1 )!, m> 1 . 

12. By a suitable change of variables it is sometimes possible to transform another differential 
equation into a Bessel equation. For example, show that a solution of 

x 2 y" + (a 2 p 2 x 2 P + | - v 2 p 2 ) y = 0, x > 0 

is given by y = x 1/2 f(ax ^), where/© is a solution of the Bessel equation of order v. 

13. Using the result of Problem 12, show that the general solution of the Airy equation 

y" — xy — 0, x > 0 

is y = x 1/2 [ci/i(|/x 3/2 ) + c 2 /2(|/x 3/2 )], where /i© and / 2 © are a fundamental set of 
solutions of the Bessel equation of order one-third. 

14. It can be shown that J 0 has infinitely many zeros for x > 0. In particular, the first three 
zeros are approximately 2.405, 5.520, and 8.653 (see Figure 5.7.1). Let kj,j = 1,2,3,..., 
denote the zeros of / 0 ; it follows that 

fl, x = 0, 

7 o(V)=| 0 , x = i. 

Verify that y = Jo ©x) satisfies the differential equation 

y" + -y' + xjy = 0, 

X J 


x > 0. 
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CHAPTER 


The Laplace 
Transform 


6 


Many practical engineering problems involve mechanical or electrical systems acted 
on by discontinuous or impulsive forcing terms. For such problems the methods 
described in Chapter 3 are often rather awkward to use. Another method that is espe¬ 
cially well suited to these problems, although useful much more generally, is based 
on the Laplace transform. In this chapter we describe how this important method 
works, emphasizing problems typical of those that arise in engineering applications. 


6.1 Definition of the Laplace Transform 


Improper Integrals. Since the Laplace transform involves an integral from zero to infin¬ 
ity, a knowledge of improper integrals of this type is necessary to appreciate the 
subsequent development of the properties of the transform. We provide a brief review 
of such improper integrals here. If you are already familiar with improper integrals, 
you may wish to skip over this review. On the other hand, if improper integrals are 
new to you, then you should probably consult a calculus book, where you will find 
many more details and examples. 

An improper integral over an unbounded interval is defined as a limit of integrals 
over finite intervals; thus 



a) 


where A is a positive real number. If the integral from a to A exists for each A > a, 
and if the limit as A oo exists, then the improper integral is said to converge to 
that limiting value. Otherwise the integral is said to diverge, or to fail to exist. The 
following examples illustrate both possibilities. 
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EXAMPLE 

1 


EXAMPLE 

2 


EXAMPLE 

3 


Let f{t) = e ct , t > 0, where c is a real nonzero constant. Then 


poo pA 

/ e ct dt = lim 

Jo Jo 


e ct dt = lim / = lim — 


A 

0 


= lim -(e cA - 1). 

C 

It follows that the improper integral converges to the value — 1/c if c < 0 and diverges if c > 0. 
If c = 0, the integrand fit) is the constant function with value 1. In this case 

lim f 1 dt = lim {A — 0) = oo, 

A^-oo J q A—>oo 

so the integral again diverges. 


Let f{t) = l/t, t > l.Then 


r°° dt r A 

l T-is. I , 


dt 


lim In A. 

A—y oo 


Since lim In A = oo, the improper integral diverges. 


Let fit) = t p , t > 1, where p is a real constant and p ^ 1; the case p = 1 was considered in 
Example 2. Then 


/>oo pA 

/ r p dt= lim / t~ p dt 

J i J i 


lim -- 

A^-oo 1 — p 


(A l ~ p 


1 ). 


As A -> oo, A 1 p —y 0 if p > 1, but A 1 p ->• oo if p < 1. Hence J t p dt converges to the 
value 1 jip — 1) for p > 1 but (incorporating the result of Example 2) diverges for p < 1. 

OO 

These results are analogous to those for the infinite series J2 n ~ p • 

n =1 


noo 

Before discussing the possible existence of / f{t)dt , it is helpful to define 

J a 

certain terms. A function / is said to be piecewise continuous on an inter¬ 
val a < £ < ft if the interval 1 can be partitioned by a finite number of points 
a = to < t\ < • ■ • < t n — so that 

1. / is continuous on each open subinterval i < t < t t . 

2. / approaches a finite limit as the endpoints of each subinterval are approached from within 
the subinterval. 

In other words,/ is piecewise continuous on a < t < / if it is continuous there except 
for a finite number of jump discontinuities. If / is piecewise continuous on a < t < / 
for every / > a, then / is said to be piecewise continuous on t > a. An example of a 
piecewise continuous function is shown in Figure 6.1.1. 


x It is not essential that the interval be closed; the same definition applies if the interval is open at one or 
both ends. 
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FIGURE 6.1.1 A piecewise continuous function y = fit). 


The integral of a piecewise continuous function on a finite interval is just the sum 
of the integrals on the subintervals created by the partition points. For instance, for 
the function/(O shown in Figure 6.1.1, we have 


f f(t)dt= [ f(t)dt+ f f(t)dt+ [ fit) dt. 

J a J a J1 1 J h 


( 2 ) 


For the function shown in Figure 6.1.1, we have assigned values to the function at 
the endpoints a and / and at the partition points t\ and /T However, as far as the 
integrals in Eq. (2) are concerned, it does not matter whether fit) is defined at these 
points, or what values may be assigned to fit) at them. The values of the integrals in 
Eq. (2) remain the same regardless. 


Thus, if / is piecewise continuous on the interval a < t < A, then 


Hence, if / is piecewise continuous for t > a, then 


f m 

Ja 


f fit) 

Ja 


dt exists. 


dt exists for each A > a. 


However, piecewise continuity is not enough to ensure convergence of the improper 

/>oo 

integral / fit) dt , as the preceding examples show. 

J a 

If / cannot be integrated easily in terms of elementary functions, the definition of 

POO 

convergence of / fit) dt may be difficult to apply. Frequently, the most convenient 

J a 

way to test the convergence or divergence of an improper integral is by the following 
comparison theorem, which is analogous to a similar theorem for infinite series. 


Theorem 6.1.1 


If / is piecewise continuous for t > a, if \f(t)\ < git) when t > M for some positive 

POO POO 

constant M, and if / git) dt converges, then / fit) dt also converges. On the 

JM Ja 

POO POO 

other hand, if fit) > git) > 0 for t > M, and if / git) dt diverges, then / fit) dt 

JM Ja 

also diverges. 


The proof of this result from calculus will not be given here. It is made plausible, 

POO POO 

however, by comparing the areas represented by / git)dt and / \fit) \ dt. The 

Jm Jm 

functions most useful for comparison purposes are e ct and t~ p , which we considered 
in Examples 1,2, and 3. 
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The Laplace Transform. Among the tools that are very useful for solving linear differ¬ 
ential equations are integral transforms. An integral transform is a relation of the 
form 



( 3 ) 


where K(s,t ) is a given function, called the kernel of the transformation, and the 
limits of integration a and / are also given. It is possible that a = — oo, or / = oo, 
or both. The relation (3) transforms the function / into another function F , which is 
called the transform of/. 

There are several integral transforms that are useful in applied mathematics, but 
in this chapter we consider only the Laplace 1 2 transform. This transform is defined 
in the following way. Let f(t) be given for t > 0, and suppose that / satisfies certain 
conditions to be stated a little later. Then the Laplace transform of/, which we will 
denote by £{f(t)} or by F(s ), is defined by the equation 



( 4 ) 


whenever this improper integral converges. The Laplace transform makes use of 
the kernel K(s,t ) = e~ st . Since the solutions of linear differential equations with 
constant coefficients are based on the exponential function, the Laplace transform is 
particularly useful for such equations. The general idea in using the Laplace transform 
to solve a differential equation is as follows: 

1. Use the relation (4) to transform an initial value problem for an unknown function / in 
the ^-domain into a simpler problem (indeed, an algebraic problem) for F in the ^-domain. 

2. Solve this algebraic problem to find F. 

3. Recover the desired function / from its transform F. This last step is known as “inverting 
the transform.” 

In general, the parameter s may be complex, and the full power of the Laplace 
transform becomes available only when we regard F(s) as a function of a complex 
variable. However, for the problems discussed here, it is sufficient to consider only 
real values of s. The Laplace transform F of a function / exists if / satisfies certain 
conditions, such as those stated in the following theorem. 


Theorem 6.1.2 Suppose that 


1. / is piecewise continuous on the interval 0 < t < A for any positive A. 

2. |/(0I < Ke at when t > M. In this inequality, K , a , and M are real constants, K and M 
necessarily positive. 

Then the Laplace transform C{f(t)} = F(s ), defined by Eq. (4), exists for s > a. 


2 The Laplace transform is named for the eminent French mathematician P. S. Laplace, who studied the rela¬ 
tion (3) in 1782. However, the techniques described in this chapter were not developed until a century or 
more later. We owe them mainly to Oliver Heaviside (1850-1925), an innovative self-taught English elec¬ 
trical engineer, who made significant contributions to the development and application of electromagnetic 
theory. He was also one of the developers of vector calculus. 
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To establish this theorem, we must show that the integral in Eq. (4) converges for 
s > a. Splitting the improper integral into two parts, we have 

poo pM poo 

/ e~ st f{t) dt = I e~ st f(t) dt + / e~ st f{t) dt. (5) 

Jo Jo Jm 

The first integral on the right side of Eq. (5) exists by hypothesis (1) of the theorem; 
hence the existence of F(s ) depends on the convergence of the second integral. By 
hypothesis (2) we have, for t > M, 

\e~ st f(t)\ < Ke~ st e at = Ke {a ~ s) \ 

poo 

and thus, by Theorem 6.1.1, F(s ) exists provided that / e ^ a ~ s)t dt converges. Refer- 

Jm 

ring to Example 1 with c replaced by a — s, we see that this latter integral converges 
when a — s < 0, which establishes Theorem 6.1.2. 

In this chapter (except in Section 6.5), we deal almost exclusively with functions 
that satisfy the conditions of Theorem 6.1.2. Such functions are described as piecewise 
continuous and of exponential order as t -> oc. Note that there are functions that 
are not of exponential order as t -> oc. One such function is fit) = e l . As t -> oo, 
this function increases faster than Ke at regardless of how large the constants K and 
a may be. 

The Laplace transforms of some important elementary functions are given in the 
following examples. 


EXAMPLE 

4 


Let fit) = 1, t > 0. Then, as in Example 1, 



dt = — lim — 

A^-oo S 


1 

5 ’ 


5 > 0 . 


I EXAMPLE 


EXAMPLE 

6 


Let fit) = e at , t > 0. Then, again referring to Example 1, 

poo poo 

C{e at }=\ e~ st e at dt= e~ {s ~ a)t dt 

Jo Jo 


1 

-, s > a. 

s — a 


Let 


m = 


i, 
k , 
0, 


0<f <1, 
t = 1, 
t > 1, 


where k is a constant. In engineering contexts fit) often represents a unit pulse, perhaps of 
force or voltage. 

Note that / is a piecewise continuous function. Then 


£{/»} = 


poo pi 

= / e st f(t) (It - i 
Jo Jo 


f dt = - 


1 — e 


s > 0. 


Observe that C{fit )} does not depend on k , the function value at the point of discontinuity. 
Even if fit) is not defined at this point, the Laplace transform of / remains the same. Thus 
there are many functions, differing only in their value at a single point, that have the same 
Laplace transform. 
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EXAMPLE 

7 


EXAMPLE 

8 


Let f{t) = sin at, t > 0. Then 


Since 


£{sin at] = F(s) = 



e st sin at dt, 


s > 0. 


F(s) = lim / e st sin at dt, 

Jo 


upon integrating by parts, we obtain 


F(s) = lim 

A—>oo 


e st cos at 


f 

Jo 


e st cos at dt 


1 * -st 

= -/ e cos at dt. 

a a Jo 

A second integration by parts then yields 

1 s 2 

F(s) = -- / e~ st sin at dt 

a a 1 Jo 


1 s 2 

= - -F(s). 


Hence, solving for F(s), we have 


F(s) = 


a 


s 2 + a 2 ’ 


s > 0. 


Now let us suppose that/i and /2 are two functions whose Laplace transforms exist 
for s > a\ and s > a 2 , respectively. Then, for 5 greater than the maximum of a\ and < 22 , 

poo 

C{cif\ (0 + C 2/2 (0} = / e~ st [ci/i (r) + C 2/2 (r)] dt 

Jo 


hence 


t 


Cl I e Vr /| (t) dt + Cl 


r 

Jo 


st fi(t) dt; 


L{c\f \(0 + c 2 f 2 (t)} = c\C{f\(t)} + c 2 C{f 2 (t)}. 


( 6 ) 


Equation (6) states that the Laplace transform is a linear operator, and we make 
frequent use of this property later. The sum in Eq. (6) can be readily extended to an 
arbitrary number of terms. 


Find the Laplace transform of f(t) = 5e 2t — 3 sin4t, t > 0. 
Using Eq. (6), we write 

C{f(t)} = 5 C{e~ 2t ] - 3£{sin At). 

Then, from Examples 5 and 7, we obtain 

5 12 

5 + 2 s 2 + 16 ’ 


£{/»} = 


5 > 0. 
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PROBLEMS 


In each of Problems 1 through 4, sketch the graph of the given function. In each case deter¬ 
mine whether / is continuous, piecewise continuous, or neither on the interval 0 < t < 3. 


i. fa) = 


t 2 , 

0<t<l 


't 2 . 

0 < t < 1 

2 + 1, 

l<t<2 

2. fit) = 

it -1 )' 

1 < t < 2 

6 — t, 

2 < t < 3 


.1, 

2 < t < 3 

t\ 

0 < t < 1 


t, 

0 < t < 1 

1, 

1 < t <2 

4. fit) = 

3 -t, 

1 < t <2 

3 — t, 

2 < t < 3 


1, 

2 < t < 3 


3. fit) = 


5. Find the Laplace transform of each of the following functions: 

(a) fit) = t 

(b) fit) = t 2 

(c) f{t ) = t n , where n is a positive integer 

6. Find the Laplace transform of fit) = cos at , where a is a real constant. 

Recall that cosh bt = ie bt + e~ bt ) /2 and sinh bt = ie bt — e~ bt ) /2. In each of Problems 7 through 

10, find the Laplace transform of the given function; a and b are real constants. 

7. fit) = cosh bt 8. fit) = sinh bt 

9. fit) = e at cosh bt 10. fit) = e at sinh bt 

Recall that cos bt = ie lbt + e~ lbt )/2 and that sin bt = ie ibt — e~ lbt )/2i. In each of Problems 11 
through 14, find the Laplace transform of the given function; a and b are real constants. 
Assume that the necessary elementary integration formulas extend to this case. 

11. fit) = sin bt 12. fit) = cos bt 

13. fit) = e at sin bt 14. fit) = e at cos bt 

In each of Problems 15 through 20, use integration by parts to find the Laplace transform of 
the given function; n is a positive integer and a is a real constant. 

15. fit) = te at 16. fit) = t sin at 

17. fit) = t cosh at 18. fit) = t n e at 

19. fit) = t 2 sin at 20. fit) = t 2 sinh at 

In each of Problems 21 through 24, find the Laplace transform of the given function. 


2L fit) = 


23. fit) = 


1, 0 < t < 71 

0, 7T <t < OQ 


0 < t < 1 
1 < t < 00 


22. fit) = 


24. fit) = 


t , 0 < t < 1 

0, 1 < t < oo 

t , 0 < t < 1 

2 — t, 1 < t < 2 
0, 2 < t < oo 


In each of Problems 25 through 28, determine whether the given integral converges or diverges. 


/•OO 

25. / it 2 + l)” 1 dt 
Jo 

/ oo 

r V dt 


26. 

28. 



te 1 dt 
e~ l cos t dt 
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29. Suppose that/ and/' are continuous for t > 0 and of exponential order as t oo. Use 
integration by parts to show that if F(y) = £{/(/)}, then lim F(T) = 0. The result is actually 

s-> oo 

true under less restrictive conditions, such as those of Theorem 6.1.2. 

30. The Gamma Function. The gamma function is denoted by T(p) and is defined by the 
integral 



(i) 


The integral converges as oo for all p. For p < 0 it is also improper at x = 0, 
because the integrand becomes unbounded as x -> 0. However, the integral can be shown 
to converge at x = 0 for p > — 1. 

(a) Show that, for p > 0, 


T(p + l)=pr(p). 


(b) Show that T(l) = 1. 

(c) If p is a positive integer n, show that 


r(n + l) =n\. 


Since F(p) is also defined when p is not an integer, this function provides an extension 
of the factorial function to nonintegral values of the independent variable. Note that it is 
also consistent to define 0! = 1. 

(d) Show that, for p > 0, 


pip + l)(p + 2) • • • ip + n - 1) = Tip + rD/Tip). 


Thus T(p) can be determined for all positive values of p if Tip) is known in a single interval 
of unit length—say, 0 < p < 1. It is possible to show that T (\) — Jjt . Find T (|) and T (y). 

31. Consider the Laplace transform of t p , where p > — 1. 

(a) Referring to Problem 30, show that 




It is possible to show that 



hence 


C{t 1/2 } = yfnjs. 


s > 0. 


(d) Show that 


C{t x/2 } = V n/i2s 3/2 ), 5 > 0. 
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6.2 Solution of Initial Value Problems 


In this section we show how the Laplace transform can be used to solve initial value 
problems for linear differential equations with constant coefficients. The usefulness 
of the Laplace transform for this purpose rests primarily on the fact that the transform 
off is related in a simple way to the transform off. The relationship is expressed in 
the following theorem. 


Theorem 6.2.1 Suppose that / is continuous and f is piecewise continuous on any interval 
0 < t < A. Suppose further that there exist constants K, a, and M such that 
|/(0I < Ke at for t > M. Then C{f\t)} exists for s > a, and moreover, 

C{f'(t)} = s£{f(t)}-m. (1) 


To prove this theorem, we consider the integral 



(0 dt , 


whose limit as A —> oo, if it exists, is the Laplace transform off'. To calculate this limit 
we first need to write the integral in a suitable form. Iff has points of discontinuity 
in the interval 0 < t < A, let them be denoted by q, • • • ,tk- Then we can write the 
integral as 

[ e~ st f\t) dt — f e~ st f'(t ) dt + f e~ st f\t) <#+•••+ f e~ st f(t) dt. 

JO Jo J t\ J tk 

Integrating each term on the right by parts yields 



(0 dt = e s, f(t ) 


+ e~ s ‘f(t) 


tl 

h 


+ ... + e- st f(t ) 


A 

tk 


+ S 





Since / is continuous, the contributions of the integrated terms at fe? • • • Jk cancel. 
Further, the integrals on the right side can be combined into a single integral, so that 
we obtain 



(0 dt = e sA f(A) - /(O) + s 



e st f(t)dt. 


( 2 ) 


Now we let A ->► oo in Eq. (2). The integral on the right side of this equa¬ 
tion approaches £{f(t)}. Further, for A > M, we have \f(A)\ < Ke aA ; consequently, 
\e~ sA f(A)\ < Ke~ {s ~ a)A . Hence e~ sA f(A ) 0 as A oo whenever s > a. Thus the 

right side of Eq. (2) has the limit s£{f(t)} —/(0) . Consequently, the left side of 
Eq. (2) also has a limit, and as noted above, this limit is £{f(t)}. Therefore, for s > a, 
we conclude that 

£{f(t)}=s£{f(t)}-f( 0), 


which establishes the theorem. 
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Corollary 6.2.2 


EXAMPLE 

1 


If/ 7 and/ 7 satisfy the same conditions that are imposed on / and/', respectively, 
in Theorem 6.2.1, then it follows that the Laplace transform of f" also exists for s > a 
and is given by 

C{f\t)}=sC{f(t)}-f\ 0) 

= s[s£{f(t)}-fm-f'(P) 

= s 2 C{f(t)}-sf(0)-f(0). (3) 

Indeed, provided the function / and its derivatives satisfy suitable conditions, an 
expression for the transform of the nth derivative / (7) can be derived by n successive 
applications of this theorem. The result is given in the following corollary. 


Suppose that the functions/,/',... ,/ (w 1} are continuous and that/ (7) is piecewise 
continuous on any interval 0 < t < A. Suppose further that there exist constants 
K,a, and M such that \f(t)\ < Ke at , \f\t)\ < Ke a \ ..., l/^COI < Ke at for t > M. 
Then £{/ (7) (0} exists for s > a and is given by 

C{f (n \t)} = s n c{f(t)} - s n ~ 1 f (0)- sf (n ~ 2 \ 0) -/ ( ”- 1) (0). (4) 


We now show how the Laplace transform can be used to solve initial value prob¬ 
lems. It is most useful for problems involving nonhomogeneous differential equations, 
as we will demonstrate in later sections of this chapter. However, we begin by looking 
at some homogeneous equations, which are a bit simpler. 


Consider the differential equation 


f -y'-2y = 0 (5) 

and the initial conditions 

y(0) = 1, /(0) = o. (6) 

This problem is easily solved by the methods of Section 3.1. The characteristic equation is 

r 2 — r — 2 = (r — 2)(r + 1) = 0, 

and consequently, the general solution of Eq. (5) is 

y = cie~ f + c 2 e 2t . (7) 

To satisfy the initial conditions (6), we must have c\ + c 2 = 1 and —c\ + 2c 2 = 0; hence c\ = \ 
and c 2 = |, so the solution of the initial value problem (5) and (6) is 

y = 0(0 = + \e 2t . ( 8 ) 

Now let us solve the same problem by using the Laplace transform. To do this, we must 
assume that the problem has a solution y = 0(7), which with its first two derivatives satisfies the 
conditions of Corollary 6.2.2. Then, taking the Laplace transform of the differential equation 
(5), we obtain 


C{y"}-£{?}-2£{y} = 0, 


(9) 
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where we have used the linearity of the transform to write the transform of a sum as the sum 
of the separate transforms. Upon using the corollary to express £{/'} and £{/} in terms of 
£{y}, we find that Eq. (9) becomes 

s 2 C{y} - sy(0) - /(0) - [s£{y} - y(0)] - 2 C{y] = 0, 


or 

(s 2 -s- 2 )Y(s) + (1 - s)y( 0) - /(0) = 0, (10) 


where Y(s) = C{y}. Substituting for y(0) and/(0) in Eq. (10) from the initial conditions (6), 
and then solving for Y (s), we obtain 


Y(s) = 


s- 1 

5 2 - 5 - 2 


s-1 

(s-2)(s + l)‘ 


( 11 ) 


We have thus obtained an expression for the Laplace transform Y ( 5 ) of the solution y = 4>(t) of 
the given initial value problem. To determine the function 0, we must find the function whose 
Laplace transform is Y(s), as given by Eq. (11). 

This can be done most easily by expanding the right side of Eq. (11) in partial fractions. 
Thus we write 


Y(s) = 


s-1 

(s-2)(s + l) 


a b 

S^Us+l 


a(s + 1) + b(s — 2) 
(s-2)(s + l) 


( 12 ) 


where the coefficients a and b are to be determined. By equating numerators of the second 
and fourth members of Eq. (12), we obtain 


5 — 1 = a{s + 1) + b(s — 2), 


an equation that must hold for all 5 . In particular, if we set s = 2, then it follows that a — |. 
Similarly, if we set s = —1, then we find that b = |. By substituting these values for a and b, 
respectively, we have 


Y(s) = 


1/3 2/3 

5^2 + sTT' 


(13) 


Finally, if we use the result of Example 5 of Section 6.1, it follows that \e 2t has the transform 
| (5 — 2) -1 ; similarly, has the transform |(s + l) -1 . Hence, by the linearity of the Laplace 
transform, 


y = 4>(f) = W‘ + \e ' 


has the transform (13) and is therefore the solution of the initial value problem (5), (6). Observe 
that it does satisfy the conditions of Corollary 6.2.2, as we assumed initially. Of course, this is 
the same solution that we obtained earlier. 


The same procedure can be applied to the general second order linear equation 
with constant coefficients 

ay” + by'+cy =f(t). (14) 

Assuming that the solution y = 0(0 satisfies the conditions of Corollary 6.2.2 for 
n = 2, we can take the transform of Eq. (14) and thereby obtain 

a[s 2 Y(s) - sy(i)) - /(0)] + b[sY(s) - y(0)] + cY(s) = F(s), (15) 

where F(s ) is the transform of fit). By solving Eq. (15) for Y (s), we find that 

(as + b)y( 0) + ay'( 0) F(s) 

= - 2 i u ■ - + - 

as z + bs + c 


as 2 + bs + c 


(16) 













320 


Chapter 6 . The Laplace Transform 


The problem is then solved, provided that we can find the function y = fit) whose 
transform is Y is). 

Even at this early stage of our discussion we can point out some of the essential 
features of the transform method. In the first place, the transform Y is) of the unknown 
function y = fit) is found by solving an algebraic equation rather than a differential 
equation , Eq. (10) rather than Eq. (5) in Example 1, or in general Eq. (15) rather than 
Eq. (14). This is the key to the usefulness of Laplace transforms for solving linear, 
constant coefficient, ordinary differential equations—the problem is reduced from 
a differential equation to an algebraic one. Next, the solution satisfying given initial 
conditions is automatically found, so that the task of determining appropriate values 
for the arbitrary constants in the general solution does not arise. Further, as indicated 
in Eq. (15), nonhomogeneous equations are handled in exactly the same way as 
homogeneous ones; it is not necessary to solve the corresponding homogeneous 
equation first. Finally, the method can be applied in the same way to higher order 
equations, as long as we assume that the solution satisfies the conditions of Corollary 
6.2.2 for the appropriate value of n. 

Observe that the polynomial as 2 + bs + c in the denominator on the right side of 
Eq. (16) is precisely the characteristic polynomial associated with Eq. (14). Since the 
use of a partial fraction expansion of Y (s) to determine fit) requires us to factor this 
polynomial, the use of Laplace transforms does not avoid the necessity of finding 
roots of the characteristic equation. For equations of higher than second order, this 
may require a numerical approximation, particularly if the roots are irrational or 
complex. 

The main difficulty that occurs in solving initial value problems by the transform 
method lies in the problem of determining the function y = fit) corresponding to 
the transform Yis). This problem is known as the inversion problem for the Laplace 
transform; fit) is called the inverse transform corresponding to Y is), and the process 
of finding fit) from Y is) is known as inverting the transform. We also use the notation 
£ -1 {Y(s)} to denote the inverse transform of Yis). There is a general formula for 
the inverse Laplace transform, but its use requires a familiarity with functions of a 
complex variable, and we do not consider it in this book. However, it is still possible 
to develop many important properties of the Laplace transform, and to solve many 
interesting problems, without the use of complex variables. 

In solving the initial value problem (5), (6), we did not consider the question of 
whether there may be functions other than the one given by Eq. (8) that also have 
the transform (13). By Theorem 3.2.1 we know that the initial value problem has no 
other solutions. We also know that the unique solution (8) of the initial value problem 
is continuous. Consistent with this fact, it can be shown that if / and g are continuous 
functions with the same Laplace transform, then / and g must be identical. On the 
other hand, if / and g are only piecewise continuous, then they may differ at one or 
more points of discontinuity and yet have the same Laplace transform; see Example 6 
in Section 6.1. This lack of uniqueness of the inverse Laplace transform for piecewise 
continuous functions is of no practical significance in applications. 

Thus there is essentially a one-to-one correspondence between functions and their 
Laplace transforms. This fact suggests the compilation of a table, such as Table 6.2.1, 
giving the transforms of functions frequently encountered, and vice versa. The entries 
in the second column of Table 6.2.1 are the transforms of those in the first column. 
Perhaps more important, the functions in the first column are the inverse transforms 
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TABLE 6.2.1 Elementary Laplace Transforms 



f{t) = C~ x {F{s)} 

F(s) = C{f(t)} 

Notes 

1. 

1 

5 > 0 

Sec. 6.1; Ex. 4 

2. 

e at 

1 

-, s > a 

s — a 

Sec. 6.1; Ex. 5 

3. 

t n , n = positive integer 

n ! 

— 7 , s > 0 

s n +i 

Sec. 6.1; Prob. 31 

4. 

rH 

1 

A 

rip + D 

-71-, S > 0 

s p+i 

Sec. 6.1; Prob. 31 

5. 

sin at 

a 

f+j- * >o 

Sec. 6.1; Ex. 7 

6. 

cos at 

*»0 

s 2 + a 2 

Sec. 6.1; Prob. 6 

7. 

sinh at 

a i i 

2 2 , s > \ a \ 
s 2 — a 2 

Sec. 6.1; Prob. 8 

8. 

cosh at 

s 

2 2 , S>|«| 

s 2 — a 2 

Sec. 6.1; Prob. 7 

9. 

e at sin bt 

(s — a) 2 + b 2 ’ S>a 

Sec. 6.1; Prob. 13 

10. 

e al cos bt 

s — a 

(s — a) 2 + b 2 ’ S> ° 

Sec. 6.1; Prob. 14 

11. 

t n e a ‘, n = positive integer 

n\ 

-r, s > a 

(, s - a) n+1 

Sec. 6.1; Prob. 18 

12. 

Ucit) 

p-cs 

— , s> 0 

s 

Sec. 6.3 

13. 

Uc(t) fit - c) 

e~ cs F(s) 

Sec. 6.3 

14. 

e c ‘f it) 

F(s — c) 

Sec. 6.3 

15. 

fict) 

vo- «*• 

Sec. 6.3; Prob. 25 

16. 

f fit ~ r)g(r) dr 

Jo 

F(s)G(s) 

Sec. 6.6 

17. 

S(t - c) 

e~ cs 

Sec. 6.5 

18. 

f (n) it) 

s n F(s) sF-'fiO) f (n ~ l) i 0) 

Sec. 6.2; Cor. 6.2.2 

19. 

i-t) n fit) 

F (n) (s) 

Sec. 6.2; Prob. 29 
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of those in the second column. Thus, for example, if the transform of the solution of 
a differential equation is known, the solution itself can often be found merely by 
looking it up in the table. Some of the entries in Table 6.2.1 have been used as 
examples, or appear as problems in Section 6.1, while others will be developed later 
in the chapter. The third column of the table indicates where the derivation of the 
given transforms may be found. Although Table 6.2.1 is sufficient for the examples and 
problems in this book, much larger tables are also available (see the list of references 
at the end of the chapter). Transforms and inverse transforms can also be readily 
obtained electronically by using a computer algebra system. 

Frequently, a Laplace transform F{s) is expressible as a sum of several terms 

F(s) = Fiis) + F 2 (s) H-h F n (s). (17) 

Suppose that/) (t) = £ _1 {Fi(s)},... ,/„(?) = £ _1 {F„(s)}. Then the function 

fit) = flit) + -'-+fn(t) 

has the Laplace transform F(s). By the uniqueness property stated previously, no 
other continuous function / has the same transform. Thus 

/T 1 ^)} = /T 1 ^)} + • • • + F _1 {F„(s)}; (18) 

that is, the inverse Laplace transform is also a linear operator. 

In many problems it is convenient to make use of this property by decomposing a 
given transform into a sum of functions whose inverse transforms are already known 
or can be found in the table. Partial fraction expansions are particularly useful for 
this purpose, and a general result covering many cases is given in Problem 39. Other 
useful properties of Laplace transforms are derived later in this chapter. 

As further illustrations of the technique of solving initial value problems by means 
of the Laplace transform and partial fraction expansions, consider the following 
examples. 


EXAMPLE 

2 


Find the solution of the differential equation 

y" + y = sin 2 1 


satisfying the initial conditions 

y(0) = 2, /(0) = 1. 


(19) 

( 20 ) 


We assume that this initial value problem has a solution y = 0(0, which with its first two 
derivatives satisfies the conditions of Corollary 6.2.2. Then, taking the Laplace transform of 
the differential equation, we have 

s 2 Y(s ) - sy(0) - /(0) + Y(s) = 2 /(s 2 + 4), 


where the transform of sin 2 1 has been obtained from line 5 of Table 6.2.1. Substituting for y (0) 
and /(0) from the initial conditions and solving for Y (s), we obtain 


2s 3 + s 2 + 8s + 6 
( s 2 + l)(s 2 + 4) 


Using partial fractions, we can write Y(s) in the form 


us -\- b cs -\- d {us -\- b)(s 2 -K 4) -b {cs 4- d){s 2 4-1) 

y 0) = —r + —7 = 

5 2 + 1 s 2 + 4 


( 21 ) 


(s 2 + l)(s 2 4- 4) 


(22) 
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EXAMPLE 

3 


By expanding the numerator on the right side of Eq. (22) and equating it to the numerator in 
Eq. (21), we find that 

2s 3 -b s 2 -b Ss ~b 6 = (a - b c^s 3 -b {b -\- d)s 2 ~\~ (4 CL ~b c^s -b (4 b -b d ) 


for all Then, comparing coefficients of like powers of s, we have 


a c — 2, b + d — 1, 
4a + c = 8, 4b + d = 6. 


Consequently, a = 2, c = 0, b = |, and d = — |, from which it follows that 


Y(s) = 


2s 

s 2 + l 



2/3 

s 2 + 4’ 


From lines 5 and 6 of Table 6.2.1, the solution of the given initial value problem is 

y = 0(0 = 2 cos t + | sin t — | sin2 1. 


(23) 


(24) 


Find the solution of the initial value problem 

y 

y(0) = 0, /(0) = 1, 


(4) -y = o, 


/(0) = o, y"(0) = o. 


(25) 

(26) 


In this problem we need to assume that the solution y = 4>{t) satisfies the conditions of 
Corollary 6.2.2 for n = 4. The Laplace transform of the differential equation (25) is 

s 4 Y(s) - S 3 y(0) - s 2 /(0) - j/(0) - y"’( 0) - Y(s) = 0. 

Then, using the initial conditions (26) and solving for Y(5), we have 


Y(s) = 


s 4 - 1 


(27) 


A partial fraction expansion of Y (s) is 


as -\- b cs + d 

= T —T + “nET’ 
s 2 — 1 s 2 4-1 


and it follows that 


(as b)(s 2 + 1 ) + (cs + d)(s 2 — 1 ) — s 2 ( 28 ) 

for all s. By setting ^ = 1 and s = — 1, respectively, in Eq. (28), we obtain the pair of equations 

2 (a + b) = 1 , 2(— a + b) = 1 , 

and therefore a = 0 and b = If we set 5 = 0 in Eq. (28), then b — d = 0, so d = Finally, 
equating the coefficients of the cubic terms on each side of Eq. (28), we find that a + c = 0, so 
c = 0. Thus 

y(s) = + ¥h' (29) 

and from lines 7 and 5 of Table 6.2.1, the solution of the initial value problem (25), (26) is 

sinh t + sin t 


y = 0(0 = 


(30) 
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PROBLEMS 


The most important elementary applications of the Laplace transform are in the 
study of mechanical vibrations and in the analysis of electric circuits; the govern¬ 
ing equations were derived in Section 3.7. A vibrating spring-mass system has the 
equation of motion 

d 2 u du , 

tn—z- + y— +ku = F{t), (31) 

dF dt 

where m is the mass, y the damping coefficient, k the spring constant, and F(t) the 
applied external force. The equation that describes an electric circuit containing an 
inductance L, a resistance R , and a capacitance C (an LRC circuit) is 


L 


d 2 Q 
dt 2 


dQ 1 

+ R l + c Q = m ' 


(32) 


where Q(t) is the charge on the capacitor and E(t) is the applied voltage. In terms of 
the current I(t ) = dQ(t)/dt , we can differentiate Eq. (32) and write 


d 2 I dl 

L—— + R ——|- 
dt 2 dt 


1 dE 
C dt 


( 0 . 


(33) 


Suitable initial conditions on u , Q , or I must also be prescribed. 

We have noted previously, in Section 3.7, that Eq. (31) for the spring-mass system 
and Eqs. (32) or (33) for the electric circuit are identical mathematically, differing 
only in the interpretation of the constants and variables appearing in them. There 
are other physical problems that also lead to the same differential equation. Thus, 
once the mathematical problem is solved, its solution can be interpreted in terms of 
whichever corresponding physical problem is of immediate interest. 

In the problem lists following this and other sections in this chapter are numerous 
initial value problems for second order linear differential equations with constant 
coefficients. Many can be interpreted as models of particular physical systems, but 
usually we do not point this out explicitly. 


In each of Problems 1 through 10, find the inverse Laplace transform of the given function. 


F(s) = 

3 

2. 

F(s) = 

4 

s 2 + 4 

(S - 1)3 

F(s) = 

2 

4. 

F(s) = 

3s 

s 2 + 3s - 4 

5 2 — 5 — 6 

F(s) = 

2 s + 2 

6. 

F(s) = 

CO 

1 

n 

s 2 + 2s + 5 

s 2 — 4 

F(s) = 

2^ + 1 

8. 

F(s) = 

8s 2 - 4s + 12 

s 2 — 2s + 2 

s(s 2 + 4) 

F(s) = 

1-25 

10. 

F(s) = 

2s-3 

s 2 + 4s + 5 

s 2 + 2s + 10 


In each of Problems 11 through 23, use the Laplace transform to solve the given initial value 
problem. 

11. y" - y - 6y = 0; y(0) = 1 , y'( 0) = -1 

12. y" + 3/ + 2y = 0; y(0) = 1, /(0) = 0 
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13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 
21 . 
22. 
23. 


y" - 2y' + 2y = 0; 
y" - 4/ + 4y = 0; 
y" - 2/ + 4y = 0; 
y" + 2y' + 5y = 0; 


y(0) = o, /(0) = i 
y(0) = i, y(0) = i 
y(0) = 2, y(0) = o 
y( 0) = 2, y'(0) = —l 

y(0) = 0, y'(0) = 1, y"(0) = 0, 

- y = 0; y( 0) = 1, y'(0) = 0, y /r (0) = 1, y'"(0) = 0 

( 4 ) - 4y = 0; y(0) = 1, y'(0) = 0, y"(0) = -2, y"'(0) = 0 

■" + &> 2 y = cos2t, w 2 7 ^ 4; y(0) = 1, y'(0) = 0 

" — 2y' + 2y = cos t; y(0) = 1, y'(0) = 0 

" — 2 y' + 2y = e~ f ; y(0) = 0, y'(0) = 1 


v( 4 ) 


v(4) 


- Ay"' + 6y" - Ay’ + y = 0; 


y'"(0) = 1 


In each of Problems 24 through 27, find the Laplace transform Y(s) = C{y} of the solution of 
the given initial value problem. A method of determining the inverse transform is developed 
in Section 6.3. You may wish to refer to Problems 21 through 24 in Section 6.1. 


24. y" + 4y = 

25. ?'+y = 

26. y" + 4y = 

27. y"+y = « 


1, 0 < t < 7T, 

0, 7i < t < oo; 

t , 0 < t < 1, 

0, 1 < t < oo; 

t , 0 < t < 1, 

1, 1 < t < oo; 

t, 0 < f < 1, 

2 — t, 1 < t < 2, 
0, 2 < t < oo; 


y(0) = 1, y'(0) = 0 

y(0) = 0, y'( 0) = 0 

37(0) = 0, y(0) = 0 

>7(0) = 0, y'(0) = 0 


28. The Laplace transforms of certain functions can be found conveniently from their Taylor 
series expansions. 

(a) Using the Taylor series for sin t 


oo 

sint = J2 

n =0 


(~l) n t 2n+1 
(2n +1)! ’ 


and assuming that the Laplace transform of this series can be computed term by term, 
verify that 

£{sint} = s>l. 

s z + 1 


(b) Let 


{ (sin t)/t, t t^O, 

1, t = 0. 


Find the Taylor series for / about t = 0. Assuming that the Laplace transform of this 
function can be computed term by term, verify that 


C{f(t)} = arctan(l/s), 


s > 1. 
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(c) The Bessel function of the first kind of order zero, / 0 , has the Taylor series (see 
Section 5.7) 


Mt) = £ 

n =0 


(-1 ) n t 2n 
2 2n (n\) 2 


Assuming that the following Laplace transforms can be computed term by term, verify 
that 

= (s 2 +1 r 1/2 , s >i 

and 

£Uo(VO} = s“V 1/(%) , s > 0. 


Problems 29 through 37 are concerned with differentiation of the Laplace transform. 

29. Let 

/•OO 

F(s) = / e~ st f{t) dt. 

Jo 

It is possible to show that as long as / satisfies the conditions of Theorem 6.1.2, it is 
legitimate to differentiate under the integral sign with respect to the parameter 5 when 

s > a. 

(a) Show that F'(s) = C{—tf{t)}. 

(b) Show that T (n) (s) = £{(—t) n f(t)}; hence differentiating the Laplace transform corre¬ 
sponds to multiplying the original function by — t. 

In each of Problems 30 through 35, use the result of Problem 29 to find the Laplace transform 
of the given function; a and b are real numbers and n is a positive integer. 


'L 

II 

0 

CO 

31. f{t) = t 2 sin bt 

32. f{t) = t n 

33. fit) = t n e at 

34. f(t) = sin bt 

35. fit) = te at cos bt 

36. Consider Bessel’s equation of order zero 

ty" 

+ 

+ 

II 

0 


Recall from Section 5.7 that t = 0 is a regular singular point for this equation, and therefore 
solutions may become unbounded as t -> 0. However, let us try to determine whether there 
are any solutions that remain finite at t = 0 and have finite derivatives there. Assuming 
that there is such a solution y = 0(t), let Y(s) = C{4>(t)}. 

(a) Show that Y ( 5 ) satisfies 


(1+s 2 )Y'(s)+sY(s) = 0. 

(b) Show that Y(s) = c( 1 + s 2 )~ 1/2 , where c is an arbitrary constant. 

(c) Writing (1 + s 2 )~ 1/2 = ^(l + s ~ 2 )~ lf2 , expanding in a binomial series valid for s > 1, 
and assuming that it is permissible to take the inverse transform term by term, show that 


OO 

y = c Y 


n =0 


(-1 ) n t 2n 
2 2n (nl) 2 


cJo(0, 


where J 0 is the Bessel function of the first kind of order zero. Note that /o(0) = 1 and that 
Jo has finite derivatives of all orders at t = 0. It was shown in Section 5.7 that the second 
solution of this equation becomes unbounded as t 0. 
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37. For each of the following initial value problems, use the results of Problem 29 to find 
the differential equation satisfied by Y ( 5 ) = £{0(t)}, where y = (p(t) is the solution of the 
given initial value problem. 

(a) y" — ty = 0; y(0) = 1, /(0) = 0 (Airy’s equation) 

(b) (1 — t 2 )y" — 2 ty' + a (a + 1 )y = 0; y(0) = 0, /(0) = 1 (Legendre’s equation) 

Note that the differential equation for Y ( 5 ) is of first order in part (a), but of second order 
in part (b). This is due to the fact that t appears at most to the first power in the equation 
of part (a), whereas it appears to the second power in that of part (b). This illustrates that 
the Laplace transform is not often useful in solving differential equations with variable 
coefficients, unless all the coefficients are at most linear functions of the independent 
variable. 

38. Suppose that 

git) = f /( t ) dr. 

Jo 

If G(s) and F(s) are the Laplace transforms of g(t) and f(t), respectively, show that 

G(s) = F(s)/s. 

39. In this problem we show how a general partial fraction expansion can be used to calculate 
many inverse Laplace transforms. Suppose that 

F(s) = P(s)/ Q{s), 

where Q(s) is a polynomial of degree n with distinct zeros ri,...,r„, and P(s) is a 
polynomial of degree less than n. In this case it is possible to show that P(s)/Q(s) has 
a partial fraction expansion of the form 

P(s) _ Aj A n 

Q(s) s-r 1 s-r n 9 

where the coefficients Ai,...,A n must be determined. 

(a) Show that 

A k = P(r k )/Q'(r k ), k = l,...,n. (ii) 

Hint: One way to do this is to multiply Eq. (i) by s — r k and then to take the limit as s ^ r k . 

(b) Show that 


6.3 Step Functions 


In Section 6.2 we outlined the general procedure involved in solving initial value 
problems by means of the Laplace transform. Some of the most interesting elemen¬ 
tary applications of the transform method occur in the solution of linear differential 
equations with discontinuous or impulsive forcing functions. Equations of this type 
frequently arise in the analysis of the flow of current in electric circuits or the vibra¬ 
tions of mechanical systems. In this section and the following ones, we develop some 
additional properties of the Laplace transform that are useful in the solution of such 
problems. Unless a specific statement is made to the contrary, all functions appearing 
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below will be assumed to be piecewise continuous and of exponential order, so that 
their Laplace transforms exist, at least for s sufficiently large. 

To deal effectively with functions having jump discontinuities, it is very helpful 
to introduce a function known as the unit step function or Heaviside function. This 
function will be denoted by u c and is defined by 


u c (t) = 


t < c, 
t > c. 


a) 


Since the Laplace transform involves values of t in the interval [0, oo), we are also 
interested only in nonnegative values of c. The graph of y = u c (t) is shown in Figure 
6.3.1. We have somewhat arbitrarily assigned the value one to u c at t = c. However, 
for a piecewise continuous function such as u c , the value at a discontinuity point is 
usually irrelevant. The step can also be negative. For instance, Figure 6.3.2 shows the 
graph ofy = 1 - u c (t). 


y 


y 


l 


FIGURE 6.3.1 


c t 

Graph of y = u c (t). 


1 


FIGURE 6.3.2 


c t 

Graph of y = 1 — u c (t ). 


EXAMPLE 

1 


Sketch the graph of y = h(t), where 


hit) = u„(t) - u 2n (t), t > 0. 


From the definition of u c (t) in Eq. (1), we have 


h(t) = 


0-0 = 0 , 
1-0 = 1 , 
1-1 = 0 , 


0 < t < 7T, 

7 T < t < 2jT, 

2tt < t < oo. 


Thus the equation y = hit) has the graph shown in Figure 6.3.3. This function can be thought 
of as a rectangular pulse. 




n 2n 3 k t 

FIGURE 6.3.3 Graph of y = u„it) — U 2 nit)- 
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EXAMPLE 

2 


Consider the function 


f(t) = 


2 , 

5, 

- 1 , 

1 , 


0 < f < 4, 
4 < f < 7, 
7 < f < 9, 
t > 9, 


whose graph is shown in Figure 6.3.4. Express/(f) in terms of w c (f). 


( 2 ) 


5 

4 

3 

2 

1 


2 4 6 8 10 12 t 


-1 - 

FIGURE 6.3.4 Graph of the function in Eq. (2). 


We start with the function f\ (f) = 2, which agrees with/(f) on [0,4). To produce the jump 
of three units at t = 4, we add 3 u 4 (t) to/i(f), obtaining 

fi(t) =2 + 3w 4 (f), 

which agrees with /(f) on [0,7). The negative jump of six units at f = 7 corresponds to 
adding —6u 7 (t), which gives 

/3(f) = 2 + 3^4(0 — 6uj(t). 

Finally, we must add 2u 9 (t) to match the jump of two units at t = 9. Thus we obtain 

/(f) = 2 + 3^4(0 — 6 ^ 7(0 + 2ug(t). (3) 


The Laplace transform of u c for c > 0 is easily determined: 

poo poo 

C{u c (t)} = J e~ st u c (t)dt = J e~ st dt 
e~ cs 

= -, s > 0. (4) 

For a given function / defined for f > 0, we will often want to consider the related 
function g defined by 

0, f < c, 

fit - c), f > c, 


T = g(0 = 
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Theorem 6.3.1 


which represents a translation of / a distance c in the positive t direction; see Fig¬ 
ure 6.3.5. In terms of the unit step function we can write g(t) in the convenient 
form 


git) = u c (t)f(t-c). 


y 

0 ) 


t 



(a) (b) 

FIGURE 6.3.5 A translation of the given function. ( a ) y — f(t)\ ( b ) y = u c (t)f(t - c). 


The unit step function is particularly important in transform use because of the fol¬ 
lowing relation between the transform of fit) and that of its translation u c (t)f(t — c). 


If F(s) = C{f(t)} exists for s > a > 0, and if c is a positive constant, then 

£{u c (t)f(t - c)} = e~ a C{f(t)} = e~ cs F(s), s > a. (5) 

Conversely, if/(0 = £ -1 {F(s)}, then 

u c (t)f(t -c) = £ _1 {e _cs F(s)}. (6) 


Theorem 6.3.1 simply states that the translation of fit) a distance c in the positive 
t direction corresponds to the multiplication of F(s) by e~ cs . To prove Theorem 6.3.1, 
it is sufficient to compute the transform of u c (t)f(t — c): 

POO 

C{u c (t)f(t — c)} = / e~ st u c (t)f(t — c) dt 

Jo 

/ oo 

e~ st f{t — c) dt. 

Introducing a new integration variable % = t — c, we have 

poo poo 

C{u c (t)f(t -c)}= / e- (f+c)i /© d § 

Jo Jo 

= e~ cs F(s). 

Thus Eq. (5) is established; Eq. (6) follows by taking the inverse transform of both 
sides of Eq. (5). 

A simple example of this theorem occurs if we take f(t) = 1. Recalling that 
C{ 1} = 1/s, we immediately have from Eq. (5) that C{u c (t)} = e~ cs /s. This result 
agrees with that of Eq. (4). Examples 3 and 4 illustrate further how Theorem 6.3.1 
can be used in the calculation of transforms and inverse transforms. 
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EXAMPLE 

3 


EXAMPLE 

4 


If the function / is defined by 


m = 


{ sin t, 

sint + cos(t — 7 t/4), 


0 < t < 7t/ 4, 
t > 7T/4, 


find £{/(*)}• The graph of y = /(t) is shown in Figure 6.3.6. 



FIGURE 6.3.6 Graph of the function in Example 3. 


Note that/(0 = sint + git), where 

t < 7T/4, 
t > 7T/4. 

- tt/4) 

and 

£{/(0} = £{sint} + C{u„/ 4 (f) cos {t - 7i/4)} 
= £{sin t] + e~ ns,A C{ cos t}. 


git) = 


0 , 

COS(t — 7T/4), 


Thus 


git) = Ux/tit) COS(t - 


Introducing the transforms of sin t and cos t, we obtain 


£{/(*)} = 


l 


+ e 


-jts/4 _ 


1 + S6T 7 ™/ 4 


S 2 + 1 S 2 + 1 S 2 + 1 

You should compare this method with the calculation of C{f(t)} directly from the definition. 


Find the inverse transform of 


Fis) = 


1 — e 


From the linearity of the inverse transform, we have 




-£~ 


= t - u 2 (t)(t - 2). 
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The function f may also be written as 



0 < t < 2, 
t > 2. 


The following theorem contains another very useful property of Laplace trans¬ 
forms that is somewhat analogous to that given in Theorem 6.3.1. 


Theorem 6.3.2 ^ E(T) = L{f(t)} exists for s > a > 0, and if c is a constant, then 

C{e ct f(t)} = F(s - c), s > a + c. 
Conversely, if/ (t) = £ -1 {F(X)}, then 

e c ‘f(t) = £- 1 {F(s-c)}. 


( 7 ) 

( 8 ) 


According to Theorem 6.3.2, multiplication of fit) by e ct results in a translation of 
the transform F(s) a distance c in the positive s direction, and conversely. To prove 
this theorem, we evaluate C{e ct f(t)}. Thus 

/>oo poo 

C{e ct f(t)}= e~ s ‘e c ‘f(t)dt= e~ (s - c), f(t) dt 

Jo Jo 

= F(s - c), 

which is Eq. (7). The restriction s > a + c follows from the observation that, according 
to hypothesis (ii) of Theorem 6.1.2, \ f(t)\ < Ke at ; hence \e ct f{t)\ < Ke ^ a+c)t . Equation 
(8) is obtained by taking the inverse transform of Eq. (7), and the proof is complete. 

The principal application of Theorem 6.3.2 is in the evaluation of certain inverse 
transforms, as illustrated by Example 5. 


Find the inverse transform of 


EXAMPLE 


G(s) = 


1 


s 2 - 4s + 5' 


By completing the square in the denominator, we can write 

1 


G(s) = 


(s - 2) 2 + 1 


= F(s - 2), 


where F(s) = (s 2 + 1) \ Since C {F(»} = sin t, it follows from Theorem 6.3.2 that 

git) = £ _1 {G(^)} = e 2t sint. 


The results of this section are often useful in solving differential equations, partic¬ 
ularly those that have discontinuous forcing functions. The next section is devoted to 
examples illustrating this fact. 
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PROBLEMS In each of Problems 1 through 6, sketch the graph of the given function on the interval t > 0. 

1. g(t) = ui(t) + 2 u 3 (t) - 6u 4 (t) 2. g{t) = (t- 3)u 2 it) - it- 2)u 3 it) 

3. git) =fit - Ti )u n it), where fit) = t 1 4. git) =fit — 3 )u 3 it), where fit) = sint 

5- git) =fit - 1 )u 2 it), where fit) = 21 

6. git) = it- l)uiit) - 2 it - 2 )u 2 it) + it- 3 )u 3 it) 

In each of Problems 7 through 12: 

(a) Sketch the graph of the given function. 

(b) Express fit) in terms of the unit step function u c it). 


7. fit) = 


9. fit) = 


11. fit) = 


0, 0 < t < 3, 

-2, 3 < t < 5, 

2, 5 < t < 7, 

1, t> 7. 


1, 

P -(t- 2 ) 


0 < t < 2, 
t> 2. 


t, 0 < t < 1, 

t — 1, 1 < t < 2, 

t — 2, 2 <t < 3, 
0, t > 3. 


8. fit) = 


10. fit) = 


12. fit) = 


1, 

- 1 , 

1, 

- 1 , 

0, 


0 < t < 1, 

1 < t < 2, 

2 < t < 3, 

3 < t < 4, 
t > 4. 


t 2 , 0 < t < 2, 

1, t > 2. 


0 < t < 2, 
2 < t < 5, 
5 <t <7, 
t >7. 


In each of Problems 13 through 18, find the Laplace transform of the given function. 
13. /CO = 


0, 

(7 — 2 ) 2 , 


t < 2 
t >2 


li fm ~ "'-2,+ 2, 


t < l 

r > 1 


0, t < 7T 

15. /(t) = t — 7T, 7T < t < 2jZ 
0, t >2 jt 

17. fit) = it - 3)u 2 it) - it - 2)u 3 it) 


16. /(t) = ^(T) + 2w 3 (t) — 61/4(0 


18. /(f) = f-Ki( 0 (*-l), t>0 

In each of Problems 19 through 24, find the inverse Laplace transform of the given function. 
19. Fis) = 

21. ECO = 

23. Fis) = 


3! 

20. Fis) = 

e~ 2s 

(J - 2) 4 

s 2 + s - 2 

<N 

1 

t-H 

1 

r7 

22. Fis) = 

2e~ 2s 

s 2 - 2s + 2 

s 2 - 4 

(s - 2)e~ s 

24. Fis) = 

e~s _|_ g-2j _ g-3s _ g-4s 

s 2 - 4s + 3 

5 


25. Suppose that Fis) = C{fit)} exists for 5 > a > 0. 
(a) Show that if c is a positive constant, then 


£(/<«»= if Q, 
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(b) Show that if A: is a positive constant, then 

£-|W) = i/(0. 

(c) Show that if a and b are constants with a > 0, then 

C~ l {F(as + b)} = -e~ b ' /a f (- ) . 

a \aj 


In each of Problems 26 through 29, use the results of Problem 25 to find the inverse Laplace 
transform of the given function. 

2 n+1 n\ 2 ^ + 1 

26 - m 21 ■ F w = 


4s 2 + 45 + 5 


28. F(s) = 


1 


29. F(s) = 


9s 2 — 12s + 3 - - v- 2s _ 1 

In each of Problems 30 through 33, find the Laplace transform of the given function. In 
Problem 33, assume that term-by-term integration of the infinite series is permissible. 

1, 0<t<l 

11, 0<f<l 

I 0, t > 1 


30. fit ) - 


31. fit) = 


0, 1 < t < 2 

1, 2 < t < 3 

0, f > 3 


2n+l 


32. fit) = 1- U\ it) H-b M2n(0 - W 2 n+l(0 = 1 + ^(-1)*W*(0 

Jfe=l 

oo 

33. /(0 = 1 + ^ (—See Figure 6.3.7. 


1 -- 1 t- 1 T- 1 

i i i i i 

i i i i i 

- i i - 4—J - i ^ 

1 2 3 4 5 1 

FIGURE 6.3.7 The function fit) in Problem 33; a square wave. 


34. Let / satisfy fit + T) = fit) for all t > 0 and for some fixed positive number T\ f is said 
to be periodic with period T on 0 < t < oo. Show that 


£{/«} - 


f 


e~ st fit)dt 


1 - e~ sT 


In each of Problems 35 through 38, use the result of Problem 34 to find the Laplace transform 
of the given function. 

[l, 0<f<l, ^ , f 1, 0<f<l, 

[o, 1 < r < 2; 36 -/( f)= {- 1 , 1 < r < 2; 

f{t+ 2) = f{t). fit+ 2) =fit). 

Compare with Problem 33. See Figure 6.3.8. 


35. fit) = 
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FIGURE 6.3.8 The function/(t) in Problem 36; a square wave. 


37 . f(t) = t, 0 < t < 1 ; 

/(f + 1) =/(*). 

See Figure 6.3.9. 


38. f{t) = sin t, 0 < t < jt; 
f{t + 7T)=fit). 

See Figure 6.3.10. 



FIGURE 6.3.9 The function/(t) in 
Problem 37; a sawtooth wave. 


y 



n 2k 3k t 

FIGURE 6.3.10 The function fit) in 
Problem 38; a rectified sine wave. 


39. (a) If fit) = l — u\it), find £{/(£)}; compare with Problem 30. Sketch the graph of 

y = m- 

(b) Let git) = J /(§) where the function / is defined in part (a). Sketch the graph of 
y = g(t) and find C{git)}. 

(c) Let hit) = git) — uiit)git — 1), where g is defined in part (b). Sketch the graph of 
y = hit) and find C{hit)}. 

40. Consider the function p defined by 


Pit) = 



0 < t < 1 , 
1 < t < 2 ; 


pit+ 2) =p(t). 


(a) Sketch the graph of y = pit). 

(b) Find C{pit)} by noting that p is the periodic extension of the function h in 
Problem 39(c) and then using the result of Problem 34. 

(c) Find C{pit)} by noting that 

Pit) = f f it) dt, 

Jo 


where / is the function in Problem 36, and then using Theorem 6.2.1. 
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6.4 Differential Equations with Discontinuous Forcing Functions 


In this section we turn our attention to some examples in which the nonhomogeneous 
term, or forcing function, is discontinuous. 


EXAMPLE 

1 


Find the solution of the differential equation 

2y" +y r + 2y = g(t), 


where 


g (0 = m 5 (0 - U2Q(t) = 


5 < t < 20, 

0 < t < 5 and t > 20. 


Assume that the initial conditions are 


y(0) = 0, /(0) = 0. 


(1) 

( 2 ) 

(3) 


This problem governs the charge on the capacitor in a simple electric circuit with a unit 
voltage pulse for 5 < t < 20. Alternatively, y may represent the response of a damped oscillator 
subject to the applied force g(t). 

The Laplace transform of Eq. (1) is 

2s 2 Y(s) - 2sy(0) - 2/(0) + sY(s) - y(0) + 2Y(s) = C{u 5 (t)) - £{m 20 (0) 

= (e~ 5s - e~ 20s )/s. 


Introducing the initial values (3) and solving for Y ( 5 ), we obtain 

e -5s _ £- 20 s 

Y(?) = 2 1 -' 

s(2s 2 + s + 2 ) 

To find y = 0(0, it is convenient to write Y ( 5 ) as 

Y(s) = (e~ 5s - e- m )H(s), 


(4) 

(5) 


where 


H(s) = 


1 

s(2s 2 + ^ + 2 ) ’ 


Then, if h(t) = C (j)}, we have 


( 6 ) 


y = cp(t) = us(t)h(t — 5) — u, 2 o(t)h(t — 20). 


(7) 


Observe that we have used Theorem 6.3.1 to write the inverse transforms of e 5s H(s) and 
£- 20 s H(s), respectively. Finally, to determine h(t), we use the partial fraction expansion of 
H(s): 


H(s) = - + 
5 


bs + c 
2s 2 +s + 2' 


( 8 ) 


Upon determining the coefficients, we find that a = b = — 1, and c = — Thus 


H(s) = l -12_ *+* 

5 2s 2 + 5 + 2 


( s + ;) + i 

* W(s+l ) 2 + iI 



5 


( 9 ) 
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Then, by referring to lines 9 and 10 of Table 6.2.1, we obtain 

h{t) — \ — \ [e~ t/4 cos(Vl5t/4) + (Vl5/15)e~ t/4 sin(Vl5 t/4)j . (10) 

In Figure 6.4.1 the graph of y = (p(t) from Eqs. (7) and (10) shows that the solution consists 
of three distinct parts. For 0 < t < 5, the differential equation is 


2/+/ + 2y = 0, (11) 

and the initial conditions are given by Eq. (3). Since the initial conditions impart no energy 
to the system, and since there is no external forcing, the system remains at rest; that is, y = 0 
for 0 < t < 5. This can be confirmed by solving Eq. (11) subject to the initial conditions (3). In 
particular, evaluating the solution and its derivative at t = 5, or, more precisely, as t approaches 
5 from below, we have 

y(5) = 0, /(5) = 0. (12) 

Once t > 5, the differential equation becomes 

2/+/ + 2y = l, (13) 

whose solution is the sum of a constant (the response to the constant forcing function) and 
a damped oscillation (the solution of the corresponding homogeneous equation). The plot 
in Figure 6.4.1 shows this behavior clearly for the interval 5 < t < 20. An expression for this 
portion of the solution can be found by solving the differential equation (13) subject to the 
initial conditions (12). Finally, for t > 20 the differential equation becomes Eq. (11) again, 
and the initial conditions are obtained by evaluating the solution of Eqs. (13), (12) and its 
derivative at t = 20. These values are 

y(20) = 0.50162, /(20) = 0.01125. (14) 

The initial value problem (11), (14) contains no external forcing, so its solution is a damped 
oscillation about y = 0, as can be seen in Figure 6.4.1. 


y 1 

0.8 






0.6 






0.4 






0.2 


10 

/ 1 

20 

1 

30 

/ \ 1 

40 

I j 






t 

-0.2 







FIGURE 6.4.1 Solution of the initial value problem (1), (2), (3): 
2 y" + y + 2y = u 5 (t) - w 2 o(0, y(0) = 0, /(0) = 0. 
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Although it may be helpful to visualize the solution shown in Figure 6.4.1 as composed of 
solutions of three separate initial value problems in three separate intervals, it is somewhat 
tedious to find the solution by solving these separate problems. Laplace transform methods 
provide a much more convenient and elegant approach to this problem and to others that 
have discontinuous forcing functions. 


The effect of the discontinuity in the forcing function can be seen if we examine the 
solution 0(0 of Example 1 more closely. According to the existence and uniqueness 
Theorem 3.2.1, the solution 0 and its first two derivatives are continuous except 
possibly at the points t = 5 and t = 20, where g is discontinuous. This can also be 
seen at once from Eq. (7). One can also show by direct computation from Eq. (7) 
that 0 and 0' are continuous even at t = 5 and t = 20. However, if we calculate 0", 
we find that 

lim 0"(O = 0, lim 0"(f) = 1/2. 

t-> 5- 5+ 

Consequently, </>"(t ) has a jump of 1/2 at t = 5. In a similar way, we can show that 
0"(O has a jump of —1/2 at t = 20. Thus the jump in the forcing term g(t) at these 
points is balanced by a corresponding jump in the highest order term 2 y" on the left 
side of the equation. 

Consider now the general second order linear equation 

y" + p(t)y' + q(t)y = git), (15) 

where p and q are continuous on some interval a < t < but g is only piecewise 
continuous there. If y = 0(0 is a solution of Eq. (15), then 0 and 0' are continuous 
on a < t < but 0" has jump discontinuities at the same points as g. Similar remarks 
apply to higher order equations; the highest derivative of the solution appearing in 
the differential equation has jump discontinuities at the same points as the forcing 
function, but the solution itself and its lower derivatives are continuous even at those 
points. 


Describe the qualitative nature of the solution of the initial value problem 


EXAMPLE 

2 


where 



y" 

+ 

n 

= git), 

(16) 

3'(0) = 

0, 

3 

II 

o 

(17) 


0 , 


0 < t < 5, 


git) = ■ 

(t- 

- 5)/5, 

5 < t < 10, 

(18) 


1, 


t > 10, 



and then find the solution. 

In this example the forcing function has the graph shown in Figure 6.4.2 and is known as 
ramp loading. It is relatively easy to identify the general form of the solution. For t < 5 the 
solution is simply y = 0. On the other hand, for t > 10 the solution has the form 


y — C\ cos2t + c 2 sin 2 1 + 1/4. 


(19) 
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The constant 1/4 is a particular solution of the nonhomogeneous equation, while the other 
two terms are the general solution of the corresponding homogeneous equation. Thus the 
solution (19) is a simple harmonic oscillation about y = 1/4. Similarly, in the intermediate 
range 5 < t < 10, the solution is an oscillation about a certain linear function. In an engineering 
context, for example, we might be interested in knowing the amplitude of the eventual steady 
oscillation. 


y 

1 

0.5 


y = gtt) 


5 10 15 20 t 


FIGURE 6.4.2 Ramp loading; y = g(t) from Eq. (18) or Eq. (20). 


To solve the problem, it is convenient to write 

g(t) = [u 5 m - 5) - u 10 m - 10)] /5, (20) 

as you may verify. Then we take the Laplace transform of the differential equation and use 
the initial conditions, thereby obtaining 

(.s 2 + 4) Y(s) = (e“ 5s - e~ 10s )/5s 2 


or 


Y(s) = (e~ 5s - e~ Ws )H(s)/5, 


( 21 ) 


where 

< 22 > 

Thus the solution of the initial value problem (16), (17), (18) is 

y = (p(t) = \us{t)h{t — 5) — uiu(t)h(t — 10)] /5, (23) 


where h(t) is the inverse transform of H(s). The partial fraction expansion of H(s) is 


H(s) =-L-- 


1/4 1/4 


s z s 2 + 4 ’ 

and it then follows from lines 3 and 5 of Table 6.2.1 that 

h{t) = \t — l sin 2 1. 


(24) 


(25) 


The graph of y = 0(0 is shown in Figure 6.4.3. Observe that it has the qualitative form that 
we indicated earlier. To find the amplitude of the eventual steady oscillation, it is sufficient to 
locate one of the maximum or minimum points for t > 10. Setting the derivative of the solution 
(23) equal to zero, we find that the first maximum is located approximately at (10.642,0.2979), 
so the amplitude of the oscillation is approximately 0.0479. 
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FIGURE 6.4.3 Solution of the initial value problem (16), (17), (18). 


Note that in this example, the forcing function g is continuous but g' is discontinuous at 
t = 5 and t = 10. It follows that the solution 0 and its first two derivatives are continuous 
everywhere, but 0has discontinuities at t = 5 and at t = 10 that match the discontinuities in 
g' at those points. 


PROBLEMS In each of Problems 1 through 13: 

(a) Find the solution of the given initial value problem. 

(b) Draw the graphs of the solution and of the forcing function; explain how they are related. 


^ [ 1, 0 < t < 3 tt 

41 1. y"+y= f(t); y(0) = 0, /(0) = 1; /(f) = ’ “ 

10, 3tt < t < o 

41 2. y" + 2y' +2y = h(t); y(0) = 0, /(0) = 1; 


h(t) = 


1, 7T < t < 27T 

0, 0 < t < 7i and t >2 tt 


3. 

/' 

+ 4y = sin £ - 

- U 2 7T it) sin(£ — 27 t); 

3 

II 

p 

y'(0) = 

0 


4. 

/' 

+ 4y = sin t - 

f ^(t) sin(t — 7 r); 

'rS 

3 

II 

o 

y'(0) = o 









fi, 

o 

A 

A 

h - 1 

O 

5. 

r 

II 

& 

+ 

& 

+ 

V 

3 

II 

p 

X. 

3 

II 

p 

/(*) = 

|o. 

t > 10 

6. 

/ 

II 

& 

+ 

& 

+ 

R 

V 

3 

II 

O 

y'(0) = l 




7. 

y" 

+ y = U 3x (t); 

3 

II 

p 

3 

II 

o 




8. 

y" 

II 

inl^ 

+ 

+ 

f - U n/2 (t)(t - n/ 2); 

3 

II 

o 

y’(0) = 

0 







It/2, 

0 < t 

< 6 

9. 

y" 

'So 

II 

+ 

y(0) = o, /(()) 

= i; g(t) 


t > 6 







1 

sint, 

0 < t < 7T 

10. 

y" 

+y + iy = g(t); y(0) = o, 

/(0) = 0 ; 

g(D = 

o, 

t > 7T 

11. 

y" 

+ 4 y = u n (t ) 

1 

R 

U> 

3 

n 

O 

x. 

3 

II 

0 
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4fl 12. y (4) -y = u 1 (t)~ u 2 (ty, y(0) = 0, /(()) = 0, y"(0) = 0, y"'(0) = 0 

4fl 13. y t4) +5y" + 4y=\ -M,(0; y(0) = o, y'(0) = 0, y"(0) = 0, /"(()) = 0 

14. Find an expression involving u c {t ) for a function/ that ramps up from zero at t = to to the 
value h at t = to + k. 

15. Find an expression involving u c {t) for a function g that ramps up from zero at t = to to the 
value h at t = t 0 + k and then ramps back down to zero at t = to + 2k. 

16. A certain spring-mass system satisfies the initial value problem 

u" + \u' + u = kg(t ), w(0) = 0, u\ 0) = 0, 

where g(t) = u^^it) — us/ 2 {t ) and k > 0 is a parameter. 

(a) Sketch the graph of g(t). Observe that it is a pulse of unit magnitude extending over 
one time unit. 

(b) Solve the initial value problem. 

(c) Plot the solution for k = 1/2, k = 1, and k = 2. Describe the principal features of the 
solution and how they depend on k. 

(d) Find, to two decimal places, the smallest value of k for which the solution u(t ) reaches 
the value 2. 

(e) Suppose k = 2. Find the time r after which \u{t)\ < 0.1 for all t > t. 

17. Modify the problem in Example 2 of this section by replacing the given forcing function 
git) by 

fit) = [u 5 (t)(t - 5) - u 5+k (t)(t - 5 - k)] /k. 

(a) Sketch the graph of f{t) and describe how it depends on k. For what value of k is f(t) 
identical to g(t) in the example? 

(b) Solve the initial value problem 

y" + 4y =fit), y(0) = 0, /(0) = 0. 

(c) The solution in part (b) depends on k , but for sufficiently large t the solution is always 
a simple harmonic oscillation about y = 1/4. Try to decide how the amplitude of this 
eventual oscillation depends on k. Then confirm your conclusion by plotting the solution 
for a few different values of k. 

18. Consider the initial value problem 

y" + \y' + *y=f k {t), y(0) = 0, /(0) = 0, 

where 

_ Jl/2k, 4 — k<t<4 + k 

0 < t < 4 — k and t>4 + k 


and 0 < k < 4. 

(a) Sketch the graph of f k it). Observe that the area under the graph is independent of k. 
If fkit) represents a force, this means that the product of the magnitude of the force and 
the time interval during which it acts does not depend on k. 

(b) Write f k (t) in terms of the unit step function and then solve the given initial value 
problem. 

(c) Plot the solution for k = 2, k = 1, and k = \. Describe how the solution depends on k. 
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Resonance and Beats. In Section 3.8 we observed that an undamped harmonic oscillator 
(such as a spring-mass system) with a sinusoidal forcing term experiences resonance if the 
frequency of the forcing term is the same as the natural frequency. If the forcing frequency 
is slightly different from the natural frequency, then the system exhibits a beat. In Problems 
19 through 23 we explore the effect of some nonsinusoidal periodic forcing functions. 

19. Consider the initial value problem 

y" + y=f(t), y( o) = o, y(0) = o, 

where 

n 

fit ) = «o(0 + 2 ’Y^{-l) k u kn {t). 

k= 1 

(a) Draw the graph of fit) on an interval such as 0 < t < 6jt. 

(b) Find the solution of the initial value problem. 

(c) Let n = 15 and plot the graph of the solution for 0 < t < 60. Describe the solution 
and explain why it behaves as it does. 

(d) Investigate how the solution changes as n increases. What happens as n -> oo? 

20. Consider the initial value problem 

/ + 0.1 ?+y= f(t), y (0) = 0, y (0) = 0, 

where fit) is the same as in Problem 19. 

(a) Plot the graph of the solution. Use a large enough value of n and a long enough 
^-interval so that the transient part of the solution has become negligible and the steady 
state is clearly shown. 

(b) Estimate the amplitude and frequency of the steady state part of the solution. 

(c) Compare the results of part (b) with those from Section 3.8 for a sinusoidally forced 
oscillator. 

21. Consider the initial value problem 

y" + y = git), y( 0 ) = o, y(0) = o, 

where 

n 

git ) = u 0 (t)+ y>i)* Mfcr (0. 

k =1 

(a) Draw the graph of git) on an interval such as 0 < t < 67T. Compare the graph with 
that of fit) in Problem 19(a). 

(b) Find the solution of the initial value problem. 

(c) Let n = 15 and plot the graph of the solution for 0 < t < 60. Describe the solution 
and explain why it behaves as it does. Compare it with the solution of Problem 19. 

(d) Investigate how the solution changes as n increases. What happens as n oo? 

4fl 22. Consider the initial value problem 

/ + o.iy + y = git), y( 0 ) = o, y (0) = o, 

where git) is the same as in Problem 21. 

(a) Plot the graph of the solution. Use a large enough value of n and a long enough t- 
interval so that the transient part of the solution has become negligible and the steady 
state is clearly shown. 

(b) Estimate the amplitude and frequency of the steady state part of the solution. 
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(c) Compare the results of part (b) with those from Problem 20 and from Section 3.8 for 
a sinusoidally forced oscillator. 

4fl 23. Consider the initial value problem 

y"+y = Kt), j( 0 ) = o, /(0) = o, 


where 

n 

fit ) = U 0 (t) + 2^(-l)*Kii*/ 4 (f). 

k=1 

Observe that this problem is identical to Problem 19 except that the frequency of the 
forcing term has been increased somewhat. 

(a) Find the solution of this initial value problem. 

(b) Let n >33 and plot the solution for 0 < t < 90 or longer. Your plot should show a 
clearly recognizable beat. 

(c) From the graph in part (b), estimate the “slow period” and the “fast period” for this 
oscillator. 

(d) For a sinusoidally forced oscillator, it was shown in Section 3.8 that the “slow fre¬ 
quency” is given by | co — <y 0 |/2, where co 0 is the natural frequency of the system and co is 
the forcing frequency. Similarly, the “fast frequency” is (co + cw 0 )/2. Use these expressions 
to calculate the “fast period” and the “slow period” for the oscillator in this problem. How 
well do the results compare with your estimates from part (c)? 


6.5 Impulse Functions 


In some applications it is necessary to deal with phenomena of an impulsive nature— 
for example, voltages or forces of large magnitude that act over very short time 
intervals. Such problems often lead to differential equations of the form 

ay" + by' + cy = git), (1) 

where g(t) is large during a short interval to — r < t < to + r for some r > 0, and is 
otherwise zero. 

The integral /(t), defined by 

rto+r 

Hr) = / git) dt, (2) 

Jto-T 

or, since g(t) = 0 outside of the interval (to — r,to + r), by 

/ oo 

git] dt, (3) 

-OO 

is a measure of the strength of the forcing function. In a mechanical system, where 
g(t) is a force, I(z) is the total impulse of the force g(t) over the time interval 
(to — t, to+ t). Similarly, if y is the current in an electric circuit and g(t) is the time 
derivative of the voltage, then /(r) represents the total voltage impressed on the 
circuit during the interval (to — r, to + r). 
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In particular, let us suppose that to is zero and that g(t) is given by 


g(t) = d T (t) = 


|1/(2t), 

10 , 


— T<t<T, 

t < — x or t > r, 


( 4 ) 


where r is a small positive constant (see Figure 6.5.1). According to Eq. (2) or (3), 
it follows immediately that in this case, /(t) = 1 independent of the value of r, 
as long as r 7 ^ 0. Now let us idealize the forcing function d T by prescribing it to act 
over shorter and shorter time intervals; that is, we require that r -> 0 + , as indicated 
in Figure 6.5.2. As a result of this limiting operation, we obtain 

lim d T (t) =0, t 7 ^ 0. (5) 

r^0+ 

Further, since /(r) = 1 for each r 7 ^ 0, it follows that 

lim /(r) = 1 . ( 6 ) 

T—^0+ 




1 


| -- 2t 

1 

1 

1 

1 

1 

1 

1 

T 

T 


FIGURE 6.5.1 Graph of y = d r (t ). 



Equations (5) and ( 6 ) can be used to define an idealized unit impulse function 8 , 
which imparts an impulse of magnitude one at t = 0 but is zero for all values of t 
other than zero. That is, the “function” 8 is defined to have the properties 

8(t) =0, t 7 ^ 0; (7) 



8{t) dt = 1. 


( 8 ) 
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There is no ordinary function of the kind studied in elementary calculus that satisfies 
both Eqs. (7) and (8). The “function” 8 , defined by those equations, is an example of 
what are known as generalized functions; it is usually called the Dirac 3 delta function. 
Since 8(t ) corresponds to a unit impulse at t = 0, a unit impulse at an arbitrary point 
t = t 0 is given by 8{t — to). From Eqs. (7) and (8), it follows that 


<$(£ - *o) = 0, t / to; 


( 9 ) 



8(t — to) dt = 1. 


( 10 ) 


The delta function does not satisfy the conditions of Theorem 6.1.2, but its Laplace 
transform can nevertheless be formally defined. Since 8(t) is defined as the limit 
of d T (t) as t -> 0 + , it is natural to define the Laplace transform of 8 as a similar 
limit of the transform of d T . In particular, we will assume that to > 0 and will define 
C{8(t — to)} by the equation 


C{8(t - to)} = lim C{d T {t — to)}. 

T^0+ 


( 11 ) 


To evaluate the limit in Eq. (11), we first observe that if r < to, which must eventually 
be the case as r ^ 0 + , then to — r > 0. Since d T (t — to) is nonzero only in the interval 
from to — r to to + r, we have 


C{d T (t to)} 


poo 

/ e~ st d T (t 

J o 

pto+T 

/ e~ st d T 
Jto-r 


to) dt 


to) dt. 


Substituting for d T (t — to) from Eq. (4), we obtain 


or 


C{d T (t to)} 


1 

2 r 




—St 


t=to + T 
t=to- T 


1 

_ p-sto 

1st 


(e ST - e~ ST ) 


C{d r (t - to)} = 


sinhst 


ST 


,-Sto 


( 12 ) 


3 Paul A. M. Dirac (1902-1984), English mathematical physicist, received his Ph.D. from Cambridge in 1926 
and was professor of mathematics there until 1969. He was awarded the Nobel Prize for Physics in 1933 
(with Erwin Schrodinger) for fundamental work in quantum mechanics. His most celebrated result was the 
relativistic equation for the electron, published in 1928. From this equation he predicted the existence of 
an “anti-electron,” or positron, which was first observed in 1932. Following his retirement from Cambridge, 
Dirac moved to the United States and held a research professorship at Florida State University. 
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The quotient (sinhsr)/sT is indeterminate as r -> 0 + , but its limit can be evaluated 
by L’Hopital’s 4 rule. We obtain 

sinhsT s cosh sz 

lim -= lim -= 1. 

r^0+ ST r^0+ 5* 

Then from Eq. (11) it follows that 

£{8(t - t 0 )} = e~ st \ (13) 

Equation (13) defines £{8(t — to)} for any to > 0. We extend this result, to allow to to 
be zero, by letting to -> 0 + on the right side of Eq. (13); thus 

£{8(t)} = lim = 1. (14) 

?o^O+ 


In a similar way, it is possible to define the integral of the product of the delta 
function and any continuous function /. We have 


f 


8 it — to)fit) dt = 


/ oo 

d T 

-oo 


it - to)f(t) dt. 


(15) 


Using the definition (4) of d T it) and the mean value theorem for integrals, we find 
that 


/ oo 

dr 

-OO 


(t - to)f(t) dt — — 


\ rto+r 


rt o+i 

2r Jt 0 -T 


fit) dt 


= ■ 2r-fit*) = fit*), 

where to — r < t* < to -\- r. Hence t* to as r 0 + , and it follows from Eq. (15) that 



&(t ~ Wit) dt =fit 0 ). 


(16) 


The following example illustrates the use of the delta function in solving an initial 
value problem with an impulsive forcing function. 


EXAMPLE 

1 


Find the solution of the initial value problem 

2 y" + y' + 2y = 8 it — 5), (12) 

y(0) = 0, /(0) = 0. (18) 

This initial value problem arises from the study of the same electric circuit or mechanical 
oscillator as in Example 1 of Section 6.4. The only difference is in the forcing term. 

To solve the given problem, we take the Laplace transform of the differential equation and 
use the initial conditions, obtaining 

(2s 2 + s + 2) Y(s) = e~ 5s . 


4 Marquis Guillaume de L’Hopital (1661-1704) was a French nobleman with deep interest in mathematics. 
For a time he employed Johann Bernoulli as his private tutor in calculus. L’Hopital published the first 
textbook on differential calculus in 1696; in it appears the differentiation rule that is named for him. 
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Thus 


Y(s) = 


1 


2s 2 + s + 2 2 (i + \ ) 2 + || 

By Theorem 6.3.2 or from line 9 of Table 6.2.1, 


1 


('+!)+§ 

Hence, by Theorem 6.3.1, we have 


. vis 


■s/15 


■ t. 


9 /7c 

y = £ _1 {y(s)) = —= Us(t)e~ (t ~ 5)/4 sin —— (t — 5), 
V15 4 


(19) 


( 20 ) 


( 21 ) 


which is the formal solution of the given problem. It is also possible to write y in the form 


y = 


0 , 

— L= e~ (t ~ 5)/4 sin (t — 5), 

a/15 4 


t < 5, 
t > 5. 


( 22 ) 


The graph of Eq. (22) is shown in Figure 6.5.3. Since the initial conditions at t = 0 are 
homogeneous and there is no external excitation until t = 5, there is no response in the interval 
0 < t < 5. The impulse at t = 5 produces a decaying oscillation that persists indefinitely. The 
response is continuous at t = 5 despite the singularity in the forcing function at that point. 
However, the first derivative of the solution has a jump discontinuity at t = 5, and the second 
derivative has an infinite discontinuity there. This is required by the differential equation (17), 
since a singularity on one side of the equation must be balanced by a corresponding singularity 
on the other side. 


y> 

0.3 






0.2 






0.1 


1 


1 

^— 1. 

-0.1 


5 

_ 

10 

15 

o 

CM 


FIGURE 6.5.3 Solution of the initial value problem (17), (18): 
2y" +y + 2y = 8(t - 5), y(0) = 0, /(0) = 0. 


In dealing with problems that involve impulsive forcing, the use of the delta 
function usually simplifies the mathematical calculations, often quite significantly. 
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However, if the actual excitation extends over a short, but nonzero, time interval, 
then an error will be introduced by modeling the excitation as taking place instan¬ 
taneously. This error may be negligible, but in a practical problem it should not be 
dismissed without consideration. In Problem 16 you are asked to investigate this 
issue for a simple harmonic oscillator. 


PROBLEMS In each of Problems 1 through 12: 

(a) Find the solution of the given initial value problem. 

(b) Draw a graph of the solution. 


02/ 1. y' + 2/ + 2y = 8(f-n); yCO) = 1, y'(0) = 0 

02, 2. y" + 4y = S(t -it)- S(t - 2n); y( 0) = 0, y'(0) = 0 

02/ 3. y" + 3y' + 2y = S(t - 5) + u 10 (t); y(0) = 0, y'(0) = 1/2 

01 4. y" — y = —20S(t — 3); y(0) = 1, y'(0) = 0 

02/ 5. y" + 2y' + 3y = sin t + S(t — 3n); y(0) = 0, y'(0) = 0 

01 6. y" + 4y = 8(t-4n); y(0) = 1/2, y'(0) = 0 

02/ 7. y" + y = S(t - 2n) cos t; y(0) = 0, y'(0) = 1 

02/ 8. y" + 4y = 25(f - jt/ 4); y(0) = 0, y'(0) = 0 

02/ 9. y" + y = u„ /2 (t) +3 S(t - 3n/2) - u 2n (t ); y(0) = 0, y'(0) = 0 

02/ 10. 2y" +y' + 4y = S(t — n/6) sinf; y(0) = 0, y'(0) = 0 

02/ 11. y" + 2y' + 2y = cos t + S(t — n/2); y(0) = 0, y'(0) = 0 

02/ 12. y (4) — y = S(t — 1); y(0) = 0, y'(0) = 0, y"(0) = 0, y"'(0) = 0 

13. Consider again the system in Example 1 of this section, in which an oscillation is excited 
by a unit impulse at t = 5. Suppose that it is desired to bring the system to rest again after 
exactly one cycle—that is, when the response first returns to equilibrium moving in the 
positive direction. 

(a) Determine the impulse k8(t — to) that should be applied to the system in order to 
accomplish this objective. Note that k is the magnitude of the impulse and to is the time 
of its application. 

(b) Solve the resulting initial value problem, and plot its solution to confirm that it 
behaves in the specified manner. 

14. Consider the initial value problem 


y" + yy' + y = s(t - 1), y(0) = o, / (0) = o, 


where y is the damping coefficient (or resistance). 

(a) Let y = \. Find the solution of the initial value problem and plot its graph. 

(b) Find the time t\ at which the solution attains its maximum value. Also find the 
maximum value y\ of the solution. 

(c) Let y = \ and repeat parts (a) and (b). 

(d) Determine how t\ and yi vary as y decreases. What are the values of t\ and y\ when 
y = 0? 

15. Consider the initial value problem 


y" + yy' + y = kbit - 1), y(0) = o, /(0) = o, 
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where k is the magnitude of an impulse at t = 1, and y is the damping coefficient (or 
resistance). 

(a) Let y = \. Find the value of k for which the response has a peak value of 2; call this 
value k \. 

(b) Repeat part (a) for y = \- 

(c) Determine how k\ varies as y decreases. What is the value of k\ when y = 0? 

^2y 16. Consider the initial value problem 

f + y=fk(t), y( 0) = o, /(0) = o, 

where fk(t) = — U 4 + k(t)]/ 2 k with 0 < k < 1. 

(a) Find the solution y = 0(t, k ) of the initial value problem. 

(b) Calculate lim 0(t, k ) from the solution found in part (a). 

&-»• o+ 

(c) Observe that lim fk(t) = 8 (t — 4). Find the solution 0 o (O of the given initial value 

k— >0+ 

problem with fk(t) replaced by 8(t — 4). Is it true that 0o(O = lim (p(t , k)l 

0+ 

(d) Plot 0(t, 1/2), 0(t, 1/4), and 0 o (O on the same axes. Describe the relation between 
(p(t,k) and 0o(O- 


Problems 17 through 22 deal with the effect of a sequence of impulses on an undamped 
oscillator. Suppose that 

f + y = m, y(0) = o, /(0) = 0. 


For each of the following choices for f(t): 

(a) Try to predict the nature of the solution without solving the problem. 

(b) Test your prediction by finding the solution and drawing its graph. 

(c) Determine what happens after the sequence of impulses ends. 


zu 

4fl 17. fit) =Z8(t- kit) 


20 


19. fit) =ZS(t- kn/2) 


18. /(f) = E(-l)* +1 W-for) 

k= 1 

_ 20 

4fl 20. fit ) = E(-l) fc+1 5(l-^/2) 

k= 1 

_ _ 40 

41 2L /w = E - Ok - 1)7r] ^ 22. /(f) = E(-D fc+1 5a - ll*/4) 

k= 1 Ar=l 

23. The position of a certain lightly damped oscillator satisfies the initial value problem 

20 

y" + 0.1/ + y = y>l/ +1 S(f - kit), y(0) = 0, /(0) = 0. 


k =1 
15 


Observe that, except for the damping term, this problem is the same as Problem 18. 

(a) Try to predict the nature of the solution without solving the problem. 

(b) Test your prediction by finding the solution and drawing its graph. 

(c) Determine what happens after the sequence of impulses ends. 

24. Proceed as in Problem 23 for the oscillator satisfying 

15 

/' + 0.1/ +y=Y / 8[t-i2k- l)jr], y(0) = 0, /(0) = 0. 

k=1 


Observe that, except for the damping term, this problem is the same as Problem 21. 
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25. (a) By the method of variation of parameters, show that the solution of the initial value 
problem 


y" + 2/ + 2y = fit)' y(0) = 0, / (0) = 0 


is 

y = f e~^~ T) fiz) sin(t — r) dr. 

Jo 

(b) Show that if fit) = 8 it — tt), then the solution of part (a) reduces to 


y = UxiOe {t n) sin(t - tt). 


(c) Use a Laplace transform to solve the given initial value problem with 
fit) = 8 it — n), and confirm that the solution agrees with the result of part (b). 


6.6 The Convolution Integral 


Sometimes it is possible to identify a Laplace transform His) as the product of two 
other transforms F is) and Gis), the latter transforms corresponding to known func¬ 
tions / and g , respectively. In this event, we might anticipate that His) would be 
the transform of the product of / and g . However, this is not the case; in other 
words, the Laplace transform cannot be commuted with ordinary multiplication. 
On the other hand, if an appropriately defined “generalized product” is introduced, 
then the situation changes, as stated in the following theorem. 


Theorem 6.6.1 


If Fis) = C{fit)} and Gis) = C{git)} both exist for s > a > 0, then 

His) = Fis)Gis) = C{hit)}, s > a, (1) 

where 


hit) = 


[ fit - r)giz)dr = \ 
Jo Jo 


fix)git - t) dr. 


( 2 ) 


The function h is known as the convolution of / and g ; the integrals in Eq. (2) are 
called convolution integrals. 


The equality of the two integrals in Eq. (2) follows by making the change of vari¬ 
able t — r = § in the first integral. Before giving the proof of this theorem, let us 
make some observations about the convolution integral. According to this theorem, 
the transform of the convolution of two functions, rather than the transform of their 
ordinary product, is given by the product of the separate transforms. It is conven¬ 
tional to emphasize that the convolution integral can be thought of as a “generalized 
product” by writing 


hit) = (f*g)(t). 


( 3 ) 
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In particular, the notation (f * g)(t) serves to indicate the first integral appearing 
in Eq. (2). 

The convolution / * g has many of the properties of ordinary multiplication. For 
example, it is relatively simple to show that 


f*g = g*f 

(commutative law) 

(4) 

f*(gl+g2)=f*gl+f*g2 

(distributive law) 

(5) 

(f*g)*h=f*ig*h) 

(associative law) 

(6) 

/ * 0 = 0 */ = 0. 


(7) 


In Eq. (7) the zeros denote not the number 0 but the function that has the value 0 
for each value of t. The proofs of these properties are left to you as exercises. 

However, there are other properties of ordinary multiplication that the convolution 
integral does not have. For example, it is not true in general that / * 1 is equal to /. 
To see this, note that 


f 


(/*!)(?)= / fit - z) - ldx = / fit -x) dr. 




If, for example, fit) = cos t , then 


(/* 1)(0 


-r 

Jo 


cos (t — r) dr = — sin(t — r) 


T=0 


= — sin 0 + sin t 


= sint. 


Clearly, (f*l)(t) ^f(t) in this case. Similarly, it may not be true that /*/ is 
nonnegative. See Problem 3 for an example. 

Convolution integrals arise in various applications in which the behavior of the 
system at time t depends not only on its state at time t but also on its past history. 
Systems of this kind are sometimes called hereditary systems and occur in such diverse 
fields as neutron transport, viscoelasticity, and population dynamics, among others. 

Turning now to the proof of Theorem 6.6.1, we note first that if 


poo 

F(s) = / e~*md$ 
Jo 


and 


then 


G(s) = 


f 


r §ix) dx, 


Fis)Gis ) 


/»00 PC 

= / e-*mdS / 
Jo Jo 


e ST g(r)dr. 


( 8 ) 


Since the integrand of the first integral does not depend on the integration variable 
of the second, we can write F(s)G(s) as an iterated integral 


F(s)G(s) = 


poo r poo 

jj' e ~ ST gO)\J e- s Sfi%)d% dx 

poo r poo 

Jo 8( lJo e_s(4f+r) /(£>^ dr - 


( 9 ) 






352 


Chapter 6 . The Laplace Transform 


The latter integral can be put into a more convenient form by introducing a change 
of variable. Let § = t — r, for fixed r, so that = dt. Further, § = 0 corresponds to 
t = r, and § = oo corresponds to t = oo; then the integral with respect to § in Eq. (9) 
is transformed into one with respect to t : 


/>oo 

F(s)G(s) = / g(z) 
Jo 


[ 


e st f(t — t) dt 


dr. 


( 10 ) 


The iterated integral on the right side of Eq. (10) is carried out over the shaded 
wedge-shaped region extending to infinity in the tr-plane shown in Figure 6.6.1. 
Assuming that the order of integration can be reversed, we rewrite Eq. (10) so that 
the integration with respect to r is executed first. In this way we obtain 


or 


F(s)G(s) = 


mu 


f{t- z)g(z)dz 


dt 


-L 


F(s)G(s ) = / e st h(t)dt = £{h(t)}, 


where h(t ) is defined by Eq. (2). This completes the proof of Theorem 6.6.1. 


( 11 ) 

( 12 ) 



FIGURE 6.6.1 Region of integration in F(s)G(s). 


EXAMPLE 

1 


Find the inverse transform of 


H(s) = 


a 

s 2 (s 2 + a 2 )' 


(13) 


It is convenient to think of H(s) as the product of s~ 2 and a/(s 2 + a 2 ), which, according to 
lines 3 and 5 of Table 6.2.1, are the transforms of t and sin at, respectively. Hence, by Theorem 
6.6.1, the inverse transform of H{s) is 


hit ) = 


/'«- 


t) sinazdz = 


at — sin at 


(14) 


You can verify that the same result is obtained if h(t) is written in the alternative form 

hit) = / r sinad — z) dz, 

Jo 

which confirms Eq. (2) in this case. Of course, hit) can also be found by expanding His) in 
partial fractions. 
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EXAMPLE 

2 


Find the solution of the initial value problem 

y" + 4 y = g(t), (15) 

y( 0) = 3, y'( 0) = -1. (16) 

By taking the Laplace transform of the differential equation and using the initial conditions, 
we obtain 

s 2 Y{s) — 3^ + 1 + 4 Y 0) = G(s) 


or 


Y(s) = 


3s-1 G(s) 
s 2 + 4 + 7 2 +4' 


(17) 


Observe that the first and second terms on the right side of Eq. (17) contain the dependence 
of Y ( 5 ) on the initial conditions and forcing function, respectively. It is convenient to write 
Y (s) in the form 


Y(s) = 3- 


1 




V + 4 2 s 2 + 4 2 s 2 + 4 ' 

Then, using lines 5 and 6 of Table 6.2.1 and Theorem 6.6.1, we obtain 


(18) 


y = 3 cos 2 1 sin 2t + \ 


/ 


sin2(t — r)g(r) dr. 


(19) 


If a specific forcing function g is given, then the integral in Eq. (19) can be evaluated (by 
numerical means, if necessary). 


Example 2 illustrates the power of the convolution integral as a tool for writing 
the solution of an initial value problem in terms of an integral. In fact, it is possible 
to proceed in much the same way in more general problems. Consider the problem 
consisting of the differential equation 

ay" + by' + cy = g(t), (20) 


where a , b , and c are real constants and g is a given function, together with the initial 
conditions 

3 >( 0 ) = yo, y'(0) = y' 0 . (21) 

The transform approach yields some important insights concerning the structure 
of the solution of any problem of this type. 

The initial value problem (20), (21) is often referred to as an input-output problem. 
The coefficients a , b , and c describe the properties of some physical system, and g(t) 
is the input to the system. The values yo and describe the initial state, and the 
solution y is the output at time t. 

By taking the Laplace transform of Eq. (20) and using the initial conditions (21), 
we obtain 

(i as 2 + bs + c)Y(s) — (as + b)yo — ay' 0 = G(s ). 


If we let 


*(s) = 


(as + b)y 0 + ay' 0 
as 2 + bs + c 


V(s) = 


G(s ) 

as 2 + bs + c ’ 


then we can write 


Y(s) = <D(,s) + fi/(v). 


( 22 ) 

(23) 


Consequently, 


y = 4>{t) + W), 


(24) 
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PROBLEMS 


where 0(0 = C 1 {O(0} and 0(0 = C 1 {^(0}- Observe that 0(0 is the solution of 
the initial value problem 

ay" + by' + cy = 0, y(0) = y 0 , /(0) = y' Q , (25) 

obtained from Eqs. (20) and (21) by setting g(t) equal to zero. Similarly, 0(0 is the 
solution of 

ay" + by' + cy = g(t) 9 y(0) = 0, / (0) = 0, (26) 

in which the initial values yo and y' 0 are each replaced by zero. 

Once specific values of a , b , and c are given, we can find 0(0 = £ -1 {O(0} by using 
Table 6.2.1, possibly in conjunction with a translation or a partial fraction expansion. 
To find 0(0 = it is convenient to write ^(s) as 

*(0 = H(s)G(s) 9 (27) 

where H(s) = (as 2 + bs + c) -1 . The function H is known as the transfer function 5 
and depends only on the properties of the system under consideration; that is, H(s) is 
determined entirely by the coefficients a , b , and c. On the other hand, G(s) depends 
only on the external excitation g(t) that is applied to the system. By the convolution 
theorem we can write 

0(0 = £ _1 {//(0O(0} = f h(t — x)g(x) dx , (28) 

Jo 

where h(t) = C~ x {H(s) }, and g(t) is the given forcing function. 

To obtain a better understanding of the significance of h(t), we consider the case in 
which G(s) = 1; consequently, g(t) = <5(0 and ^(s) = H(s ). This means that y = h(t) 
is the solution of the initial value problem 

ay" + by' + cy = 8(t ), y( 0) = 0, y'( 0) = 0, (29) 

obtained from Eq. (26) by replacing g(t) by 8(t). Thus h(t) is the response of the 
system to a unit impulse applied at t = 0, and it is natural to call h(t) the impulse 
response of the system. Equation (28) then says that 0(0 is the convolution of the 
impulse response and the forcing function. 

Referring to Example 2, we note that in that case, the transfer function is 
H(s) = l/(s 2 + 4) and the impulse response is h(t) = (sin 20/2. Also, the first two 
terms on the right side of Eq. (19) constitute the function 0(0, the solution of the 
corresponding homogeneous equation that satisfies the given initial conditions. 


1. Establish the commutative, distributive, and associative properties of the convolution 
integral. 

(a )f*g = g*f 

(b) / * (gi + gi) = / *gi +/ * gi 

(c) f * (g*h) = (f *g) *h 


5 This terminology arises from the fact that H(s) is the ratio of the transforms of the output and the input 
of the problem (26). 
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2. Find an example different from the one in the text showing that (f * 1 )(0 need not be 
equal to f(t). 

3. Show, by means of the example fit) = sin t , that / */ is not necessarily nonnegative. 


In each of Problems 4 through 7, find the Laplace transform of the given function. 


4. 

6 . 


m = f 

Jo 

f(0 = f 

Jo 


(,t — z) 2 cos2zdz 
(t — z)e T dz 


5. 

7. 


fit) = f 

Jo 

fit) = f 

Jo 


e {t r) sin z dz 
sin(7 — r) cos r dz 


In each of Problems 8 through 11, find the inverse Laplace transform of the given function by 
using the convolution theorem. 


8. F(s) = 
10. F(s) = 


1 


s 4 (s 2 +1) 

1 


is + l) 2 (s 2 + 4) 


9. 

11 . 


F(s) = 


F(s) = 


s 

is + 1 )(s 2 + 4) 
G(s) 
s 2 + 1 


12. (a) If f{t) = t m and g(t) = t n , where m and n are positive integers, show that 


f*g = t m+n+l 



u) n du. 


(b) Use the convolution theorem to show that 


/' 


u m (l — u) n du = 


(m + n + 1)! 


(c) Extend the result of part (b) to the case where m and n are positive numbers but not 
necessarily integers. 


In each of Problems 13 through 20, express the solution of the given initial value problem in 
terms of a convolution integral. 


13. 

/' 

+ co 2 y = g(t ); y(0) 

II 

o 

X 

o 

II 

1—^ 



14. 

/' 

+ 2 y' + 2 y = sin at; 

o 

II 

o 

/(0) = 0 



15. 

4 y 

" + 4 y + 17y = g(0; 

3 

II 

o 

/( 0) = 0 



16. 

y" 

+ 

+ 

-MUi 

II 

h— 1 - 

1 

K 

54 

y(0) = 

1, /(0) = 

-1 


17. 

y" 

II 

+ 

+ 

3 

II 

1° 

y’(0) = -3 



18. 

y" 

+ 3 y' + 2 y = cos at; 

3 

II 

y’(0) = o 



19. 

y (4) -y = g(t); y( 0) = 

= 0, /(0) 

= 0, y"(< 0) 

= 0, 

/"( 0) 

20. 

y (4) + 5y" + 4 y = g(t); 

y(0) = l, 

y'(0) = o, 

y ; (0) 

= 0, 

21. 

Consider the equation 








m + 1 

J( 

3 

fit), 


in which / and k are known functions, and 0 is to be determined. Since the unknown 
function 0 appears under an integral sign, the given equation is called an integral equation; 
in particular, it belongs to a class of integral equations known as Volterra integral equations. 
Take the Laplace transform of the given integral equation and obtain an expression for 
£{0(0} in terms of the transforms C{f(t)} and C{k(t)} of the given functions / and k. The 
inverse transform of £{0(0} is the solution of the original integral equation. 
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22. Consider the Volterra integral equation (see Problem 21) 

0(0 + [ (f-£)«($)# = sin2*. (i) 

Jo 

(a) Solve the integral equation (i) by using the Laplace transform. 

(b) By differentiating Eq. (i) twice, show that 0(0 satisfies the differential equation 

0"(O + 0(0 = —4sin2t. 

Show also that the initial conditions are 


0(0) = 0, 0'(O) = 2. 


(c) Solve the initial value problem in part (b), and verify that the solution is the same as 
the one in part (a). 


In each of Problems 23 through 25: 

(a) Solve the given Volterra integral equation by using the Laplace transform. 

(b) Convert the integral equation into an initial value problem, as in Problem 22(b). 

(c) Solve the initial value problem in part (b), and verify that the solution is the same as the 
one in part (a). 


23. 0(0 + 


/«- 


?)</>© d% = \ 


24. 0(f) 


-f»- 


?)0M = l 


■l 


25. 0(0 + 2 / cos(t — §)0(f) ctt- = e 


There are also equations, known as integro-differential equations, in which both derivatives 

and integrals of the unknown function appear. In each of Problems 26 through 28: 

(a) Solve the given integro-differential equation by using the Laplace transform. 

(b) By differentiating the integro-differential equation a sufficient number of times, convert 

it into an initial value problem. 

(c) Solve the initial value problem in part (b), and verify that the solution is the same as the 

one in part (a). 

26. 0'(O + fit - ©0© dL% = t, 0(0) = 0 

Jo 

27. 4>'(t) -if (t- ?) 2 0(?) d? = -t, 0(0) = 1 

Jo 

28. 0'(O + 0(0 = f sin (t - f)0© d £, 0(0) = 1 

Jo 

29. The Tautochrone. A problem of interest in the history of mathematics is that of finding 
the tautochrone 6 —the curve down which a particle will slide freely under gravity alone, 
reaching the bottom in the same time regardless of its starting point on the curve. This 
problem arose in the construction of a clock pendulum whose period is independent of 
the amplitude of its motion. The tautochrone was found by Christian Huygens (1629- 
1695) in 1673 by geometrical methods, and later by Leibniz and Jakob Bernoulli using 
analytical arguments. Bernoulli’s solution (in 1690) was one of the first occasions on which 


6 The word “tautochrone” comes from the Greek words tauto, which means “same,” and chronos, which 
means “time.” 
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a differential equation was explicitly solved. The geometric configuration is shown in 
Figure 6.6.2. The starting point P(a, b ) is joined to the terminal point (0,0) by the arc C. 
Arc length s is measured from the origin, and f(y) denotes the rate of change of s with 
respect to y : 



Then it follows from the principle of conservation of energy that the time T ( b ) required 
for a particle to slide from P to the origin is 


T(b) = 


j=r 

y/2g Jo y/b-y 


(ii) 


y 


P{a, b ) 


C 



x 


FIGURE 6.6.2 The tautochrone. 


(a) Assume that T{b) = T 0 , a constant, for each b. By taking the Laplace transform of 
Eq. (ii) in this case, and using the convolution theorem, show that 


then show that 



(iii) 


f(y) = 


V2 g Tp 
* s/y' 


Hint: See Problem 31 of Section 6.1. 

(b) Combining Eqs. (i) and (iv), show that 


dx 2a — y 

dy 


where a = gT^/n 2 . 

(c) Use the substitution y = 2a sin 2 (0/2) to solve Eq. (v), and show that 


x = a(6 + sin0), y = a(l — cosO). 


(iv) 


(V) 


(Vi) 


Equations (vi) can be identified as parametric equations of a cycloid. Thus the tautochrone 
is an arc of a cycloid. 













358 


Chapter 6. The Laplace Transform 


REFERENCES 


The books listed below contain additional information on the Laplace transform and its applications. 
Churchill, R. V., Operational Mathematics (3rd ed.) (New York: McGraw-Hill, 1971). 

Doetsch, G., Introduction to the Theory and Application of the Laplace Transform (trans. W. Nader) (New 
York: Springer, 1974). 

Kaplan, W., Operational Methods for Linear Systems (Reading, MA: Addison-Wesley, 1962). 

Kuhfittig, R K. F., Introduction to the Laplace Transform (New York: Plenum, 1978). 

Miles, J. W., Integral Transforms in Applied Mathematics (London: Cambridge University Press, 2008). 
Rainville, E. D., The Laplace Transform: An Introduction (New York: Macmillan, 1963). 

Each of the books just mentioned contains a table of transforms. Extensive tables are also available. 
See, for example, 

Erdelyi, A. (ed.), Tables of Integral Transforms (Vol. 1) (New York: McGraw-Hill, 1954). 

Roberts, G. E., and Kaufman, H., Table of Laplace Transforms (Philadelphia: Saunders, 1966). 

A further discussion of generalized functions can be found in 

Lighthill, M. J., An Introduction to Fourier Analysis and Generalized Functions (London: Cambridge 
University Press, 1958). 



CHAPTER 


Systems of First 
Order Linear 
Equations 
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There are many physical problems that involve a number of separate elements 
linked together in some manner. For example, electrical networks have this char¬ 
acter, as do many problems in mechanics and in other fields. In these and similar 
cases, the corresponding mathematical problem consists of a system of two or 
more differential equations, which can always be written as first order equations. 
In this chapter we focus on systems of first order linear equations, and in par¬ 
ticular equations having constant coefficients, utilizing some of the elementary 
aspects of linear algebra to unify the presentation. In many respects this chap¬ 
ter follows the same lines as the treatment of second order linear equations in 
Chapter 3. 


7.1 Introduction 


Systems of simultaneous ordinary differential equations arise naturally in problems 
involving several dependent variables, each of which is a function of the same single 
independent variable. We will denote the independent variable by t and will let 
xi,X 2 ,X 3 ,... represent dependent variables that are functions of t. Differentiation 
with respect to t will be denoted by a prime. 

For example, consider the spring-mass system in Figure 7.1.1. The two masses 
move on a frictionless surface under the influence of external forces F\(t) and F 2 (t ), 
and they are also constrained by the three springs whose constants are ki,k 2 , and ^ 3 , 
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respectively. Using arguments similar to those in Section 3.7, we find the following 
equations for the coordinates x\ and *2 of the two masses: 


in i 


d 2 x i 
dt 2 


m 2 


d 2 x 2 
dt 2 


= k 2 (x 2 - xi) - k\X\ + Fi{t) 

= —(k\ + A:2 )xi + /C 2 X 2 + Fi(t), 
= k 2) x 2 - k 2 ix 2 - xi) + F 2 it) 


( 1 ) 


= k 2 x 1 - ik 2 + k 3 )x 2 + F 2 (0- 
A derivation of Eqs. (1) is outlined in Problem 17. 


\F^{t) 1 F2^t) 


K 

1 

k 2 

1 

k 3 

^JNNNNh 

1 

m 1 

1 

^wwvvw^ 

1 

m 2 

1 


l l 


FIGURE 7.1.1 A two-mass, three-spring system. 


Next, consider the parallel LRC circuit shown in Figure 7.1.2. Let V be the voltage 
drop across the capacitor and I the current through the inductor. Then, referring 
to Section 3.7 and to Problem 19 of this section, we can show that the voltage and 
current are described by the system of equations 


dl _V 
dt~L 9 
dV _ I V 
~di ~~C~ RC’ 


( 2 ) 


where L is the inductance, C is the capacitance, and R is the resistance. 



FIGURE 7.1.2 A parallel LRC circuit. 


One reason why systems of first order equations are particularly important is that 
equations of higher order can always be transformed into such systems. This is usually 
required if a numerical approach is planned, because almost all codes for generat¬ 
ing numerical approximations to solutions of differential equations are written for 
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systems of first order equations. The following example illustrates how easy it is to 
make the transformation. 


EXAMPLE 

1 


The motion of a certain spring-mass system (see Example 3 of Section 3.7) is described by the 
second order differential equation 


u " -b 0.125 u! -b u — 0. 


(3) 


Rewrite this equation as a system of first order equations. 

Let xi = u and x 2 = u'. Then it follows that x[ = x 2 . Further, u " = x' 2 . Then, by substituting 
for u , u ', and u" in Eq. (3), we obtain 

x 2 ~b 0.125x2 ~b X\ = 0. 

Thus Xi and x 2 satisfy the following system of two first order differential equations: 


x[ = x 2 , 

x 2 = — xi — 0.125x 2 . 


(4) 


The general equation of motion of a spring-mass system 

mu" + yu' + ku = Fit) (5) 

can be transformed into a system of first order equations in the same manner. If we 
let x\ — u and X 2 = u', and proceed as in Example 1, we quickly obtain the system 


x' 2 = —(k/m)x i — iy/m)X 2 + F(t)/m. 

To transform an arbitrary nth order equation 

y (n) =F(t,y,y',...,y (n - 1) ) (7) 

into a system of n first order equations, we extend the method of Example 1 by 
introducing the variables xi,X 2 ,... ,x n defined by 

xi=y, x 2 =y', xj,=y”, x n =y (n ~ 1) . (8) 


It then follows immediately that 

x[ = x 2 , 
x' 2 = X 3 , 

X ' n -1 = X„, 


(9) 


and, from Eq. (7), 


X' n =F(t,X i,X 2 ,...,X n ). 


( 10 ) 
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Equations (9) and (10) are a special case of the more general system 


A = F 1 (t,x u x 2 ,...,x n ), 
x' 2 -F 2 {t,xi,x 2 ,...,x n ), 


( 11 ) 


X' n =F n (t,X l,X 2 ,...,X n ). 


In a similar way, the system (1) can be reduced to a system of four first order equations 
of the form (11), and the system (2) is already in this form. In fact, systems of the 
form ( 11 ) include almost all cases of interest, so much of the more advanced theory 
of differential equations is devoted to such systems. 

A solution of the system (11) on the interval /: a < t < is a set of n functions 


( 12 ) 


Xi = 01 (0, *2 = 0 2(0, • • • , X n = 0«(O 


that are differentiable at all points in the interval I and that satisfy the system of equa¬ 
tions (11) at all points in this interval. In addition to the given system of differential 
equations, there may also be given initial conditions of the form 


xi(t 0 ) = *?, x 2 (to) = x°, ..., x n (t 0 ) = x° n , 


(13) 


where to is a specified value of t in /, and *?,... ,x„ are prescribed numbers. The 
differential equations (11) and the initial conditions (13) together form an initial 
value problem. 

A solution (12) can be viewed as a set of parametric equations in an /^-dimensional 
space. For a given value of t , Eqs. (12) give values for the coordinates *i,... ,x n of a 
point in the space. As t changes, the coordinates in general also change. The collection 
of points corresponding to a < t < /3 forms a curve in the space. It is often helpful to 
think of the curve as the trajectory, or path, of a particle moving in accordance with 
the system of differential equations (11). The initial conditions (13) determine the 
starting point of the moving particle. 

The following conditions on iq, F 2 ,... ,F n , which are easily checked in specific 
problems, are sufficient to ensure that the initial value problem (11), (13) has a unique 
solution. Theorem 7.1.1 is analogous to Theorem 2.4.2, the existence and uniqueness 
theorem for a single first order equation. 


Theorem 7.1.1 Let eac ^ the functions F\,,F n and the partial derivatives 3iq/3jci,..., 


dFi/dx n ,..., dF n /dx \,..., dF n / dx n be continuous in a region R of tx\x 2 ■ • • x n - 
space defined by a < t < /3, ot\ < x\ < /fi,... ,a n < x n < fi n , and let the point 
(to,*?,* 2 ’ • • • ’ X ^) be in R. Then there is an interval \t — to I < h in which there exists 
a unique solution x\ = 0 i(t),... ,x n = 0 w (t) of the system of differential equations 
(11) that also satisfies the initial conditions (13). 

The proof of this theorem can be constructed by generalizing the argument in 
Section 2.8, but we do not give it here. However, note that, in the hypotheses of the 
theorem, nothing is said about the partial derivatives of iq,... ,F n with respect to 
the independent variable t. Also, in the conclusion, the length 2 h of the interval in 
which the solution exists is not specified exactly, and in some cases it may be very 
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Theorem 7.1.2 


PROBLEMS 


short. Finally, the same result can be established on the basis of somewhat weaker but 
more complicated hypotheses, so the theorem as stated is not the most general one 
known, and the given conditions are sufficient, but not necessary, for the conclusion 
to hold. 

If each of the functions Fi,..., F n in Eqs. (11) is a linear function of the dependent 
variables xi, ... ,x n , then the system of equations is said to be linear; otherwise, it is 
nonlinear. Thus the most general system of n first order linear equations has the form 


A = Pu(t)Xi H- + Pln(t)X n + gl(t), 

A = P2\ (0*1 H-1- P2n(t)X n + gl{t), 


A = Ail (0*1 + • • ' + Pnn(t)x n + gn(0- 


(14) 


If each of the functions gi(t), ..., g n (t) is zero for all t in the interval /, then the 
system (14) is said to be homogeneous; otherwise, it is nonhomogeneous. Observe 
that the systems (1) and (2) are both linear. The system (1) is nonhomogeneous unless 
Fiit) = F 2 (t) = 0, while the system (2) is homogeneous. For the linear system (14), 
the existence and uniqueness theorem is simpler and also has a stronger conclusion. 
It is analogous to Theorems 2.4.1 and 3.2.1. 


If the functions pn, p \ 2 ,... ,p nn , gi,... ,g w are continuous on an open interval 
/: a < t < /3, then there exists a unique solution x\ = 0i(t), • • • ,x n = 0^(0 of the 
system (14) that also satisfies the initial conditions (13), where to is any point in /, 
and ..., x° n are any prescribed numbers. Moreover, the solution exists throughout 
the interval /. 


Note that, in contrast to the situation for a nonlinear system, the existence and 
uniqueness of the solution of a linear system are guaranteed throughout the interval 
in which the hypotheses are satisfied. Furthermore, for a linear system the initial 
values x \,... ,x® at t = to are completely arbitrary, whereas in the nonlinear case the 
initial point must lie in the region R defined in Theorem 7.1.1. 

The rest of this chapter is devoted to systems of linear first order equations (non¬ 
linear systems are included in the discussion in Chapters 8 and 9). Our presentation 
makes use of matrix notation and assumes that you have some familiarity with the 
properties of matrices. The basic facts about matrices are summarized in Sections 7.2 
and 7.3, and some more advanced material is reviewed as needed in later sections. 


In each of Problems 1 through 4, transform the given equation into a system of first order 
equations. 

1. u" + 0.5^ + 2u = 0 2. u" + 0.5 u' + 2u = 3 sin t 

3. t 2 u" + tu! + (t 2 — 0.25 )u = 0 4. w (4) — u = 0 






364 


Chapter 7 . Systems of First Order Linear Equations 


In each of Problems 5 and 6, transform the given initial value problem into an initial value 
problem for two first order equations. 

5. u" + 0.25 u' + 4 u = 2 cos 3 t, u( 0) = 1 , u'( 0) = —2 

6. u" + p{t)u! + q{t)u = g(t ), w(0) = u 0 , z/(0) = u' 0 

7. Systems of first order equations can sometimes be transformed into a single equation of 
higher order. Consider the system 


x[ = — 2xi + x 2 , x' 2 = x\ — 2x 2 . 


(a) Solve the first equation for x 2 and substitute into the second equation, thereby obtain¬ 
ing a second order equation for x\. Solve this equation for x\ and then determine x 2 
also. 

(b) Find the solution of the given system that also satisfies the initial conditions x\ (0) = 2, 
x 2 (0) = 3. 

(c) Sketch the curve, for t > 0, given parametrically by the expressions for x 1 and x 2 
obtained in part (b). 


In each of Problems 8 through 12, proceed as in Problem 7. 

(a) Transform the given system into a single equation of second order. 

(b) Find x\ and x 2 that also satisfy the given initial conditions. 

(c) Sketch the graph of the solution in the xix 2 -plane for t > 0. 


8 . 

10 . 

12 . 

13. 

14. 


x[ = 3xi — 2x 2 , 
x' 2 — 2x\ — 2x 2 , 
x[ = x\ — 2x 2 , 
x 2 — 3x 1 — 4x 2 , 
x[ = — 0.5xi + 2 x 2 , 
x 2 = —2x\ — 0.5x 2 , 


x\ (0) = 3 
*2(0) = \ 
* 1 ( 0 ) = -1 
x 2 (0) = 2 


Xl (0) = -2 
x 2 (0) = 2 


9. x[ = 1.25xi + 0.75x 2 , 
x' 2 = 0.75xi + 1.25 x 2 , 

11. x[ = 2x 2 , Xi(0) = 3 

x 2 = — 2xi, x 2 (0) = 4 


Xl (0) = -2 
* 2 ( 0 ) = 1 


Transform Eqs. (2) for the parallel circuit into a single second order equation. 

Show that if an, a\ 2 , a 2 1 , and a 22 are constants with a\ 2 and a 2 1 not both zero, and if the 
functions g\ and g 2 are differentiable, then the initial value problem 


x\ = d\\X\ + a 12 x 2 + gi(t), x\ (0) = x? 

x ! 2 — a 2 1X1 + a 22 x 2 + g 2 (t), x 2 (0) = x 2 


can be transformed into an initial value problem for a single second order equation. Can 
the same procedure be carried out if a n ,..., a 22 are functions of ft 

15. Consider the linear homogeneous system 

= Pu(t)x + pn(t)y, 
y' =P2i(t)x+p2z(t)y. 

Show that if x = x\{t), y = y\(t) and x = x 2 (t), y = y 2 (t) are two solutions of the given 
system, thenx = c\Xi(t) + c 2 x 2 (t), y = C\y\(t) + c 2 y 2 (t) is also a solution for any constants 
ci and c 2 . This is the principle of superposition. 
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16. Let x = xi(t), y = y 1 (t) and x = x 2 (t ), y = y 2 (t) be any two solutions of the linear 
nonhomogeneous system 

= pn(t)x + pn(t)y + gi(t), 
y' = Pn(t)x + Pzi(t)y + g 2 (t). 

Show that x = x\(t) — x 2 (t), y = y\(t) — y 2 (t) is a solution of the corresponding homoge¬ 
neous system. 

17. Equations (1) can be derived by drawing a free-body diagram showing the forces acting 
on each mass. Figure 7.1.3a shows the situation when the displacements x\ and *2 of the 
two masses are both positive (to the right) and x 2 > x 1 . Then springs 1 and 2 are elongated 
and spring 3 is compressed, giving rise to forces as shown in Figure 7.1.36. Use Newton’s 
law (F = ma) to derive Eqs. (1). 


k l 


CM 



k 3 

&AAAAA 

m 1 

^ANAN\N\fi 

CM 

s 



x i i 

CM 


(a) 



( 6 ) 

FIGURE 7.1.3 (a) The displacements x\ and *2 are both positive. 
( b ) The free-body diagram for the spring-mass system. 


18. Transform the system (1) into a system of first order equations by letting yi = x\,y 2 = x 2 , 
y 3 = x[, and y 4 = x' 2 . 

Electric Circuits. The theory of electric circuits, such as that shown in Figure 7.1.2, consisting 
of inductors, resistors, and capacitors, is based on Kirchhoff’s laws: (1) The net flow of current 
into each node (or junction) is zero, and (2) the net voltage drop around each closed loop 
is zero. In addition to Kirchhoff’s laws, we also have the relation between the current I in 
amperes through each circuit element and the voltage drop V in volts across the element: 

V = RI, R = resistance in ohms; 
dV 

C— = I, C = capacitance in farads, 
dl 

L— = V, L = inductance in henrys. 
dt : 

Kirchhoff’s laws and the current-voltage relation for each circuit element provide a system of 
algebraic and differential equations from which the voltage and current throughout the circuit 
can be determined. Problems 19 through 21 illustrate the procedure just described. 


1 Actual capacitors typically have capacitances measured in microfarads. We use farad as the unit for 
numerical convenience. 



























366 


Chapter 7 . Systems of First Order Linear Equations 


19. Consider the circuit shown in Figure 7.1.2. Let C, / 2 , and I 3 be the currents through the 
capacitor, resistor, and inductor, respectively. Likewise, let V\, V 2 , and V 3 be the corre¬ 
sponding voltage drops. The arrows denote the arbitrarily chosen directions in which 
currents and voltage drops will be taken to be positive. 

(a) Applying Kirchhoff s second law to the upper loop in the circuit, show that 


V] — V 2 = 0. 


(i) 


In a similar way, show that 


v 2 -v 3 = 0. 


(ii) 


(b) Applying Kirchhoff s first law to either node in the circuit, show that 


h+1 2 +1 3 — 0. (iii) 

(c) Use the current-voltage relation through each element in the circuit to obtain the 
equations 


CV[=h, V 2 = RI 2 , LI' = V 3 . 


(iv) 


(d) Eliminate V 2 ,V 3 , C, and I 2 among Eqs. (i) through (iv) to obtain 

CV[ = -h - L L7' = V t . 


(v) 


Observe that if we omit the subscripts in Eqs. (v), then we have the system (2) of this 
section. 

20. Consider the circuit shown in Figure 7.1.4. Use the method outlined in Problem 19 to show 
that the current I through the inductor and the voltage V across the capacitor satisfy the 
system of differential equations 


dl 

dt 


= -i ~ V, 


dV 

— =21- V. 
dt 


R = 1 ohm 



FIGURE 7.1.4 The circuit in Problem 20. 
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21. Consider the circuit shown in Figure 7.1.5. Use the method outlined in Problem 19 to show 
that the current I through the inductor and the voltage V across the capacitor satisfy the 
system of differential equations 



L 



FIGURE 7.1.5 The circuit in Problem 21. 


22. Consider the two interconnected tanks shown in Figure 7.1.6. Tank 1 initially contains 
30 gal of water and 25 oz of salt, and Tank 2 initially contains 20 gal of water and 15 oz 
of salt. Water containing 1 oz/gal of salt flows into Tank 1 at a rate of 1.5 gal/min. The 
mixture flows from Tank 1 to Tank 2 at a rate of 3 gal/min. Water containing 3 oz/gal of salt 
also flows into Tank 2 at a rate of 1 gal/min (from the outside). The mixture drains from 
Tank 2 at a rate of 4 gal/min, of which some flows back into Tank 1 at a rate of 1.5 gal/min, 
while the remainder leaves the system. 

(a) Let Qi(t) and g 2 (0? respectively, be the amount of salt in each tank at time t. Write 
down differential equations and initial conditions that model the flow process. Observe 
that the system of differential equations is nonhomogeneous. 

(b) Find the values of gi and g 2 for which the system is in equilibrium—that is, does not 
change with time. Let gf and gf be the equilibrium values. Can you predict which tank 
will approach its equilibrium state more rapidly? 

(c) Let x\ = Qi(t) — gf and x 2 = g 2 (t) — gf . Determine an initial value problem for x\ 
and x 2 . Observe that the system of equations for xi and v 2 is homogeneous. 

1.5 gal/min 1 gal/min 


tzzp 


QZZS 


1 oz/gal 


3 oz/gal 



Q^t) oz salt 
30 gal water 


3 gal/min 



Q 2 (t) oz salt 
20 gal water 



FIGURE 7.1.6 Two interconnected tanks (Problem 22). 
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23. Consider two interconnected tanks similar to those in Figure 7.1.6. Initially,Tank 1 contains 
60 gal of water and Q? oz of salt, and Tank 2 contains 100 gal of water and 2° oz °f salt. 
Water containing qi oz/gal of salt flows into Tank 1 at a rate of 3 gal/min. The mixture 
in Tank 1 flows out at a rate of 4 gal/min, of which half flows into Tank 2, while the 
remainder leaves the system. Water containing q 2 oz/gal of salt also flows into Tank 2 from 
the outside at the rate of 1 gal/min. The mixture in Tank 2 leaves it at a rate of 3 gal/min, of 
which some flows back into Tank 1 at a rate of 1 gal/min, while the rest leaves the system. 

(a) Draw a diagram that depicts the flow process described above. Let Q\(t) and Q 2 (t), 
respectively, be the amount of salt in each tank at time t. Write down differential equations 
and initial conditions for Qi and Q 2 that model the flow process. 

(b) Find the equilibrium values Qf and gf in terms of the concentrations q\ and q 2 . 

(c) Is it possible (by adjusting qi and q 2 ) to obtain gf = 60 and gf = 50 as an equilibrium 
state? 

(d) Describe which equilibrium states are possible for this system for various values of q\ 
and q 2 . 


7.2 Review of Matrices 


For both theoretical and computational reasons, it is advisable to bring some of the 
results of matrix algebra 2 to bear on the initial value problem for a system of linear 
differential equations. For reference purposes, this section and the next are devoted 
to a brief summary of the facts that will be needed later. More details can be found 
in any elementary book on linear algebra. We assume, however, that you are familiar 
with determinants and how to evaluate them. 

We designate matrices by boldfaced capitals A, B, C, ..., occasionally using bold¬ 
faced Greek capitals 4>, H*,.... A matrix A consists of a rectangular array of numbers, 
or elements, arranged in m rows and n columns—that is, 


A = 


/ a n 

012 • ' 

01 n \ 


«21 

022 

’ ’ 02 n 

(i) 

\0ml 

0m2 

’ * 0m«/ 



We speak of A as an m x n matrix. Although later in the chapter we will often assume 
that the elements of certain matrices are real numbers, in this section we assume that 


2 The properties of matrices were first extensively explored in 1858 in a paper by the English algebraist 
Arthur Cayley (1821-1895), although the word “matrix” was introduced by his good friend James Sylvester 
(1814-1897) in 1850. Cayley did some of his best mathematical work while practicing law from 1849 to 
1863; he then became professor of mathematics at Cambridge, a position he held for the rest of his life. 
After Cayley’s groundbreaking work, the development of matrix theory proceeded rapidly, with significant 
contributions by Charles Hermite, Georg Frobenius, and Camille Jordan, among others. 
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the elements of matrices may be complex numbers. The element lying in the ith row 
and yth column is designated by dy, the first subscript identifying its row and the 
second its column. Sometimes the notation (dy) is used to denote the matrix whose 
generic element is dy. 

Associated with each matrix A is the matrix A r , which is known as the transpose 
of A and is obtained from A by interchanging the rows and columns of A. Thus, if 
A = (dy), then A T = (dji). Also, we will denote by dy the complex conjugate of dy, 
and by A the matrix obtained from A by replacing each element dy by its conjugate 
dy. The matrix A is called the conjugate of A. It will also be necessary to consider 

—T 

the transpose of the conjugate matrix A . This matrix is called the adjoint of A and 
will be denoted by A*. 

For example, let 


i 3 

\4 + 3 i 



Then 


/ 3 4 + 3 i\ 

\2 — i -5 + 2 i)’ 


/ 3 2 + i \ 

\4-3i -5-2// 


A* 



4 - 3/\ 
-5-2 i) 


We are particularly interested in two somewhat special kinds of matrices: square 
matrices, which have the same number of rows and columns—that is, m = n; and 
vectors (or column vectors), which can be thought of as n x 1 matrices, or matri¬ 
ces having only one column. Square matrices having n rows and n columns are 
said to be of order n. We denote (column) vectors by boldfaced lowercase letters: 

x, y, §, rj, _The transpose x r of an n x 1 column vector is a 1 x n row vector—that 

is, the matrix consisting of one row whose elements are the same as the elements in 
the corresponding positions of x. 


Properties of Matrices. 

1. Equality. Two m x n matrices A and B are said to be equal if all corresponding 
elements are equal—that is, if dij = by for each / and j. 

2. Zero. The symbol 0 will be used to denote the matrix (or vector) each of whose 
elements is zero. 

3. Addition. The sum of two m x n matrices A and B is defined as the matrix 
obtained by adding corresponding elements: 


A + B — ( dij ) + (by) — (dij + by). 


( 2 ) 
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With this definition, it follows that matrix addition is commutative and associative, 
so that 

A + B = B + A, A + (B + C) = (A + B) + C. (3) 

4. Multiplication by a Number. The product of a matrix A by a real or complex 
number a is defined as follows: 


aA = a(dij) = (aaij); (4) 

that is, each element of A is multiplied by a. The distributive laws 

a (A + B) = aA + aB, (a + f$) A = aA + /3A (5) 

are satisfied for this type of multiplication. In particular, the negative of A, denoted 
by —A, is defined by 

-A = (—1)A. (6) 

5. Subtraction. The difference A — B of two m x n matrices is defined by 

A — B = A + (—B). (7) 

Thus 

A - B = (fly) - (bjj) = (Ay - bij), (8) 

which is similar to Eq. (2). 

6. Multiplication. The product AB of two matrices is defined whenever the num¬ 
ber of columns in the first factor is the same as the number of rows in the second. 
If A and B are m x n and n x r matrices, respectively, then the product C = AB is an 
m x r matrix. The element in the ith row and yth column of C is found by multiplying 
each element of the ith row of A by the corresponding element of the y’th column of 
B and then adding the resulting products. In symbols, 

n 

Cij = ^ ^ ttjkbjcj- ( 9 ) 

k =1 

By direct calculation, it can be shown that matrix multiplication satisfies the 
associative law 

(AB)C = A(BC) (10) 

and the distributive law 

A(B + C) = AB + AC. (11) 

However, in general, matrix multiplication is not commutative. For both products 
AB and BA to exist and to be of the same size, it is necessary that A and B be square 
matrices of the same order. Even in that case the two products are usually unequal, 
so that, in general, 


AB ^ BA. 


( 12 ) 
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EXAMPLE 

1 


To illustrate the multiplication of matrices, and also the fact that matrix multiplication is not 
necessarily commutative, consider the matrices 




-2 1^ 


'2 1 -1\ 

A = 

0 

2 -1 

B — 

1 -1 0 


l 2 

1 V 


1 

<N 

From the definition of multiplication given in Eq. (9), we have 



2-2 + 2 

1 + 2-1 

-1 + 0 +1\ 

AB = 


0 + 2-2 

0-2 + 1 

0 + 0-1 



\4 + 1 + 2 

1 

1 

(N 

—2 + 0 + lj 



/2 2 

o\ 




0 -1 - 

1 




V 0 

V 


Similarly, we find that 








o 

1 



BA = 

l -4 : 

4 




v 4 -5 

V 


Clearly, AB ^ BA. 


7. Multiplication of Vectors. There are several ways of forming a product of two 
vectors x and y, each with n components. One is a direct extension to n dimensions 
of the familiar dot product from physics and calculus; we denote it by x T y and write 

n 

Vy = J2 x m- ( 13 ) 

i =1 

The result of Eq. (13) is a real or complex number, and it follows directly from Eq. (13) 
that 

x r y = y r x, x r (y + z) = x r y + x r z, (ax) r y = a(x r y) = x r (ay). (14) 

There is another vector product that is also defined for any two vectors having the 
same number of components. This product, denoted by (x,y), is called the scalar or 
inner product and is defined by 

n 

(*>y ) = ( 15 > 

i =1 

The scalar product is also a real or complex number, and by comparing Eqs. (13) and 
(15), we see that 

(x,y)=x r y. (16) 

Thus, if all the elements of y are real, then the two products (13) and (15) are identical. 
From Eq. (15) it follows that 

(x,y + z) = (x,y) + (x,z), 

(x,«y) =«(x,y). 


(x,y) = (y,x), 
(«x,y) = a(x,y), 


( 17 ) 
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Note that even if the vector x has elements with nonzero imaginary parts, the scalar 
product of x with itself yields a nonnegative real number 


n n 

(x,x> = 'Y^xtXi = y w 2 - 

i=l i —1 


(18) 


The nonnegative quantity (x,x) 1/2 , often denoted by ||x||, is called the length, or 
magnitude, of x. If (x, y) = 0, then the two vectors x and y are said to be orthogonal. 
For example, the unit vectors i, j, k of three-dimensional vector geometry form an 
orthogonal set. On the other hand, if some of the elements of x are not real, then the 
product 

n 


x T x = Y x i 




i=i 


may not be a real number. 




For example, let 

i \ 


(2 - A 

x = 

-2 

. y = 

i 


V 1 + b 


3 / 


(19) 


Then 


x r y = ( 0(2 - 0 + (— 2)(0 + (1 + 0 ( 3 ) = 4 + 3 i, 
( x , y ) = ( 0(2 + 0 + ( — 2)(—0 + (1 + 0 ( 3 ) = 2 + 7 /, 
x r x = (/) 2 + ( — 2) 2 + (1 + /) 2 = 3 + 2/, 


(X,x) = (0(—0 + (-2)(-2) + (1 + 0(1 - 0 = 2. 


8 . Identity. The multiplicative identity, or simply the identity matrix I, is given by 


/I 0 ••• 0\ 

o i ... 0 

\o o ... \) 


( 20 ) 


From the definition of matrix multiplication, we have 

AI = IA = A (21) 

for any (square) matrix A. Hence the commutative law does hold for square matrices 
if one of the matrices is the identity. 

9. Inverse. The square matrix A is said to be nonsingular or invertible if there 
is another matrix B such that AB = I and BA = I, where I is the identity. If there is 
such a B, it can be shown that there is only one. It is called the multiplicative inverse, 
or simply the inverse, of A, and we write B = A -1 . Then 

AA- 1 = A -1 A = I. (22) 


Matrices that do not have an inverse are called singular or noninvertible. 

There are various ways to compute A -1 from A, assuming that it exists. One way 
involves the use of determinants. Associated with each element of a given matrix 
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is the minor My, which is the determinant of the matrix obtained by deleting the 
ith row and yth column of the original matrix—that is, the row and column con¬ 
taining aij. Also associated with each element is the cofactor Qj defined by the 
equation 


Qj = (-1 y+i'Mij. 


(23) 


If B = A 1 , then it can be shown that the general element bij is given by 


b 


ij ~ 


Cji m 
det A’ 


(24) 


Although Eq. (24) is not an efficient way 3 to calculate A -1 , it does suggest a con¬ 
dition that A must satisfy for it to have an inverse. In fact, the condition is both 
necessary and sufficient: A is nonsingular if and only if det A ^ 0. If det A = 0, then 
A is singular. 

Another (and usually better) way to compute A -1 is by means of elementary row 
operations. There are three such operations: 

1. Interchange of two rows. 

2. Multiplication of a row by a nonzero scalar. 

3. Addition of any multiple of one row to another row. 

The transformation of a matrix by a sequence of elementary row operations is 
referred to as row reduction or Gaussian 4 elimination. Any nonsingular matrix A 
can be transformed into the identity I by a systematic sequence of these operations. 
It is possible to show that if the same sequence of operations is then performed on I, it 
is transformed into A -1 . It is most efficient to perform the sequence of operations on 
both matrices at the same time by forming the augmented matrix A 11. The following 
example illustrates the calculation of an inverse matrix in this way. 


Find the inverse of 

EXAMPLE 

2 



-i 

-i 

2 



3 For large n the number of multiplications required to evaluate A -1 by Eq. (24) is proportional to n\. If we 
use a more efficient method, such as the row reduction procedure described in this section, the number 
of multiplications is proportional only to n 3 . Even for small values of n (such as n = 4), determinants are 
not an economical tool in calculating inverses, and row reduction methods are preferred. 

4 Carl Friedrich Gauss (1777-1855) was born in Brunswick (Germany) and spent most of his life as pro¬ 
fessor of astronomy and director of the Observatory at the University of Gottingen. Gauss made major 
contributions to many areas of mathematics, including number theory, algebra, non-Euclidean and dif¬ 
ferential geometry, and analysis, as well as to more applied fields such as geodesy, statistics, and celestial 
mechanics. He is generally considered to be among the half-dozen best mathematicians of all time. 
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We begin by forming the augmented matrix A 11: 


/I 

-1 

-1 

1 

0 

(A 

3 

-1 

2 

0 

1 

0 

V 2 

2 

3 

0 

0 

V 


The matrix A can be transformed into I by the following sequence of operations, and at the 
same time, I is transformed into A -1 . The result of each step appears below the statement. 

(a) Obtain zeros in the off-diagonal positions in the first column by adding (—3) times the 
first row to the second row and adding (—2) times the first row to the third row. 


/1 

-1 

-1 

1 

0 

0 \ 

0 

2 

5 

-3 

1 

0 

v° 

4 

5 

-2 

0 

d 


(b) Obtain a 1 in the diagonal position in the second column by multiplying the second row 

by 


1 

1 

1 0 0\ 

0 1 § 

-3 1 0 

2 2 W 

\o 4 5 

-2 0 1/ 


(c) Obtain zeros in the off-diagonal positions in the second column by adding the second row 
to the first row and adding (—4) times the second row to the third row. 


n 0 | 

-1 1 0\ 

0 1 | 

-1 l 0 

Vo 0 -5 

4 -2 1/ 


(d) Obtain a 1 in the diagonal position in the third column by multiplying the third row by 

(-})■ 


/I 0 | 

-i i 0\ 

0 1 | 

-f 1 0 

\o 0 1 

4 2 1 i 

5 5 5 / 


(e) Obtain zeros in the off-diagonal positions in the third column by adding (—|) times the 
third row to the first row and adding (— |) times the third row to the second row. 


A 

0 

0 

7 

10 

1 

10 


0 

1 

0 

1 

2 

1 

2 

1 

2 

Vo 

0 

1 

4 

5 

2 

5 

-y 


The last of these matrices is 11A 1 , a fact that can be verified by direct multiplication with 
the original matrix A. 

This example was made slightly simpler by the fact that the given matrix A had a 1 
in the upper left corner (an = 1). If this is not the case, then the first step is to produce 
a 1 there by multiplying the first row by i/an, as long as an 7^ 0. If an = 0, then the 
first row must be interchanged with some other row to bring a nonzero element 
into the upper left position before proceeding. If this cannot be done, because every 
element in the first column is zero, then the matrix has no inverse and is singular. 
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A similar situation may occur at later stages of the process as well, and the remedy 
is the same: interchange the given row with a lower row so as to bring a nonzero 
element to the desired diagonal location. If this cannot be done, then the original 
matrix is singular. 


Matrix Functions. We sometimes need to consider vectors or matrices whose elements 
are functions of a real variable t. We write 


x(t) = 


(x\ (t)\ 


\x n (t)J 


A (t) = 


( a n it) 


\^ral (0 


ainit) \ 
amn(t) / 


(25) 


respectively. 

The matrix A (t) is said to be continuous at t = to or on an interval a < t < if each 
element of A is a continuous function at the given point or on the given interval. 
Similarly, A(t) is said to be differentiable if each of its elements is differentiable, and 
its derivative dA/dt is defined by 


dA 

dt 



(26) 


that is, each element of dA/dt is the derivative of the corresponding element of A. 
In the same way, the integral of a matrix function is defined as 


For example, if 



then 


A \t) = 


/cos t 

l 0 



/' 


A(t) dt 


i r 



(27) 


Many of the rules of elementary calculus extend easily to matrix functions; in partic¬ 
ular, 


d 

dt 


d 

iA X) 

(A + B) 

d A 

i/ AB) 


dA 

dt ’ 


where C is a constant matrix; 


dA + dB 
dt dt 



dA 

+ 

dt 


(28) 

(29) 

(30) 


In Eqs. (28) and (30), care must be taken in each term to avoid interchanging the 
order of multiplication. The definitions expressed by Eqs. (26) and (27) also apply as 
special cases to vectors. 

To conclude this section: some important operations on matrices are accomplished 
by applying the operation separately to each element of the matrix. Examples include 
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PROBLEMS 


multiplication by a number, differentiation, and integration. However, this is not true 
of many other operations. For instance, the square of a matrix is not calculated by 
squaring each of its elements. 


/ 1 -2 0 \ 


1. If A = 


3 

v - 2 

(a) 2A + B 
(c) AB 

(l i 


-1 

V 


and B = 


/ 4 
-1 

V 6 


-2 

5 

1 


3\ 


2. If A = 


3 + 2/ 


-1 + 2 / 
2 -/ 


and B = 


(a) A —2B 
(c) AB 


0 

V 

(b) A - 4B 
(d) BA 

-2i)' 

(b) 3A + B 
(d) BA 


, find 



(-2 

1 

2\ 


1 

2 3\ 

3. If A = 

1 

0 

-3 

and B = 

3 

-1 -1 , find 


2 

-1 

V 


l - 2 

1 0 J 

(a) A T 





(b) 

(c) A r 

+ B r 




(d) (A + B) r 


4. If A = 


(a) A J 


5. If A = 


6. If A = 


3 — 2/ 1 + / 

2 — / —2 + 3/ 


find 


/ 3 

2 

V 1 


-i\ 

2 

V 


(b) A 
2 


and B = 


-l\ 

3 

v 


1 

-2 

°\ 


( 2 

1 

-i\ 


( 2 

1 

°\ 

3 

2 

-1 

, B = 

-2 

3 

3 

, and C = 

1 

2 

2 

v- 2 

0 

V 


l 1 

0 

V 



1 

-v 


(c) A* 

verify that 2(A + B) = 2A + 2B. 

, verify that 


(a) (AB)C = A(BC) (b) (A + B) + C = A + (B + C) 

(c) A(B + C) = AB + AC 


7. Prove each of the following laws of matrix algebra: 

(a) A + B = B + A (b) A + (B + C) = (A + B) + C 

(c) a(A + B) = aA + aB (d) (a + ft) A = aA + /3A 

(e) A(BC) = (AB)C (f) A(B + C) = AB + AC 


fi] 

and y = 

' _i q 

v-0 

1 

3 ~i) 


find 


(a) x r y 
(c) (x,y) 


(b) y r y 
(d) (y,y) 
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/l - 2A 


9. Ifx = 



and y = 



(b) (x,y) = (y, x) 


In each of Problems 10 through 19, either compute the inverse of the given matrix, or else 
show that it is singular. 


10 . 


11 . 


12. 


/I 


2 

2 4 

y3 5 6/ 


13. 


(1 1 - 1 \ 
1 

V 


2 -1 


V 1 


14. 


16. 


18. 


1 

2 

a 



( 2 

1 

°\ 


-2 

1 

8 


15. 

0 

2 

1 


1 

-2 

-v 




0 

2/ 


/I 

-1 

-1\ 




( 2 

3 

1> 


2 

1 

0 



17. 

-1 

2 

1 


V 3 

-2 

V 




l 4 

-1 



1 

0 

0 

-i\ 


/ 1 

-1 

2 

°\ 

0 

-1 

1 

0 

19. 

-1 

2 

-4 

2 

-l 

0 


L 

0 

1 

0 

1 

3 

0 

1 


L 

V 


1-2 

2 

0 

-v 


20. If A is a square matrix, and if there are two matrices B and C such that AB = I and CA = I, 
show that B = C. Thus, if a matrix has an inverse, it can have only one. 



( e 1 

2e- f 

e 2t \ 


2e' 

e 1 

3e 2 '\ 

21. If A(0 = 

2e l 

e~ f 

-e 2 ‘ 

and B (t) = 

—e‘ 

2e~ l 

e 2t 


\-e< 

3^- r 

2e 2t j 


y 3e‘ 

—e~ f 

-e 2t ) 


, find 


(a) A + 3B 
(c) dA/dt 


(b) AB 

(d) f A (t)dt 
Jo 


In each of Problems 22 through 24, verify that the given vector satisfies the given differential 
equation. 


x' = (^ J X, 


X = \3 


ir + 2 (!V e ' 


X = 
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II 

> 

xt- 

CO 

(1 1 1\ 
2 1 -1 

II 

* 

* 

R 

\e~‘+2 

R 


o 

1 

h 

h ->■ 


l-R 

1 



In each of Problems 25 and 26, verify that the given matrix satisfies the given differential 
equation. 


25. 


\ 

l\ 



/ e 

3r 

e 2 ‘\ 




= j 

i 4 



»(0 

= \-4e~ 

3 1 

e 2 ‘) 






/i 

-1 

4 \ 




e‘ 

e 

-21 

e 3 ‘\ 

26. 

v = 

3 

2 

-1 


*«) = 


-4e‘ 

—e 

-It 

2e 3 ' 



V 

1 

-v 




—e' 

—e 

-It 

e 3 ‘ j 


7.3 Systems of Linear Algebraic Equations; Linear Independence, 

Eigenvalues, Eigenvectors 

In this section we review some results from linear algebra that are important for the 
solution of systems of linear differential equations. Some of these results are easily 
proved and others are not; since we are interested simply in summarizing some useful 
information in compact form, we give no indication of proofs in either case. All the 
results in this section depend on some basic facts about the solution of systems of 
linear algebraic equations. 

Systems of Linear Algebraic Equations. A set of n simultaneous linear algebraic equations 
in n variables 


d\\X\ + $12-^2 + • • • + CllnXn ~ b\. 


&ri\X\ + ^n2 x 2 + • • ’ + MnnXn ~ b n 


(i) 


can be written as 

Ax = b, (2) 

where the n x n matrix A and the vector b are given, and the components of x are 
to be determined. If b = 0, the system is said to be homogeneous; otherwise, it is 

nonhomogeneous. 

If the coefficient matrix A is nonsingular—that is, if det A is not zero—then there 
is a unique solution of the system (2). Since A is nonsingular, A -1 exists, and the 
solution can be found by multiplying each side of Eq. (2) on the left by A -1 ; thus 

x = A -1 b. (3) 

In particular, the homogeneous problem Ax = 0, corresponding to b = 0 in Eq. (2), 
has only the trivial solution x = 0. 
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On the other hand, if A is singular—that is, if det A is zero—then solutions of 
Eq. (2) either do not exist, or do exist but are not unique. Since A is singular, A -1 
does not exist, so Eq. (3) is no longer valid. The homogeneous system 


Ax = 0 (4) 

has (infinitely many) nonzero solutions in addition to the trivial solution. The situ¬ 
ation for the nonhomogeneous system (2) is more complicated. This system has no 
solution unless the vector b satisfies a certain further condition. This condition is that 


(b,y) = 0, 


( 5 ) 


for all vectors y satisfying A*y = 0, where A* is the adjoint of A. If condition (5) is 
met, then the system (2) has (infinitely many) solutions. These solutions are of the 
form 

X = x (0) + (6) 


where x l0) is a particular solution of Eq. (2), and § is the most general solution of the 
homogeneous system (4). Note the resemblance between Eq. (6) and the solution of 
a nonhomogeneous linear differential equation. The proofs of some of the preceding 
statements are outlined in Problems 26 through 30. 

The results in the preceding paragraph are important as a means of classifying the 
solutions of linear systems. However, for solving particular systems, it is generally best 
to use row reduction to transform the system into a much simpler one from which 
the solution(s), if there are any, can be written down easily. To do this efficiently, we 
can form the augmented matrix 


A | b 


(a n ••• a ln b\ 
\flnl ’ ' ’ ^nn &n 


0) 


by adjoining the vector b to the coefficient matrix A as an additional column. The 
vertical line replaces the equals sign and is said to partition the augmented matrix. 
We now perform row operations on the augmented matrix so as to transform A into 
an upper triangular matrix—that is, a matrix whose elements below the main diagonal 
are all zero. Once this is done, it is easy to see whether the system has solutions, and 
to find them if it does. Observe that elementary row operations on the augmented 
matrix (7) correspond to legitimate operations on the equations in the system (1). 
The following examples illustrate the process. 


EXAMPLE 

1 


Solve the system of equations 


x\ — 2x2 + 3x3 = 7, 
—X\ + x 2 — 2x 3 = —5, 
2xi — x 2 — x 3 = 4. 


( 8 ) 
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The augmented matrix for the system (8) is 



1 

-2 

3 

A 


-1 

1 

-2 

-5 


2 

-1 

-1 

V 


(9) 


We now perform row operations on the matrix (9) with a view to introducing zeros in the 
lower left part of the matrix. Each step is described and the result recorded below. 

(a) Add the first row to the second row, and add (—2) times the first row to the third row. 


il 

-2 

3 

7\ 

0 

-1 

1 

2 

V° 

3 

-7 

—10/ 


(b) Multiply the second row by — 1. 


il 

-2 

3 

7\ 

0 

1 

-1 

-2 

v° 

3 

-7 

—10/ 


(c) Add (—3) times the second row to the third row. 


il 

-2 

3 

7\ 

0 

1 

-1 

-2 

\0 

0 

-4 

-a) 


(d) Divide the third row by —4. 


il 

-2 

3 

7\ 

0 

1 

-1 

-2 

\0 

0 

1 1 

V 


The matrix obtained in this manner corresponds to the system of equations 

x\ — 2x 2 + 3x 3 = 7, 

x 2 — x 3 = —2, (10) 

x 3 = 1, 


which is equivalent to the original system (8). Note that the coefficients in Eqs. (10) form 
a triangular matrix. From the last of Eqs. (10) we have x 3 = 1, from the second equation 
X 2 = —2 + x 3 = —1, and from the first equation x\ = 7 + 2x 2 — 3x 3 = 2. Thus we obtain 


x = 


2 \ 

-1 


V 


which is the solution of the given system (8). Incidentally, since the solution is unique, we 
conclude that the coefficient matrix is nonsingular. 
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EXAMPLE 

2 


Discuss solutions of the system 


x\ — 2x2 + 3x3 = 

—x\ + x 2 — 2x 3 = b 2 , 
2 xi — x 2 + 3 x 3 = b 3 


(ii) 


for various values of b 1 ,b 2 , and b 3 . 

Observe that the coefficients in the system (11) are the same as those in the system (8) except 
for the coefficient of x 3 in the third equation. The augmented matrix for the system (11) is 


1 

-2 

3 

bi\ 

-1 

1 

-2 

b 2 

2 

-1 

3 

b 3 j 


By performing steps (a), (b), and (c) as in Example 1, we transform the matrix (12) into 


( 12 ) 


h 

-2 

3 

bi \ 

0 

1 

-1 

-b\ - b 2 

V° 

0 

0 

b\ + 3b 2 + b 3 J 


The equation corresponding to the third row of the matrix (13) is 


(13) 


b t + 3b 2 + b 3 =0; (14) 

thus the system (11) has no solution unless the condition (14) is satisfied by b 3 ,b 2 , and b 3 . It is 
possible to show that this condition is just Eq. (5) for the system (11). 

Let us now assume that b\ = 2, b 2 = 1, and b 3 = —5, in which case Eq. (14) is satisfied. Then 
the first two rows of the matrix (13) correspond to the equations 

xi — 2 x 2 + 3x 3 = 2, 

, ( 15 ) 

x 2 — x 3 = —3. 

To solve the system (15), we can choose one of the unknowns arbitrarily and then solve for 
the other two. If we let x 3 = a, where a is arbitrary, it then follows that 

x 2 = a — 3, 

Xi = 2 (a — 3) — 3a + 2 = —a — 4. 


If we write the solution in vector notation, we have 



( — a — 4 ) 


(~i\ 


— 4 \ 

X = 

a — 3 

= a 

i 

+ 

-3 


\ a ) 


V 




(16) 


It is easy to verify that the second term on the right side of Eq. (16) is a solution of the nonho- 
mogeneous system (11) and that the first term is the most general solution of the homogeneous 
system corresponding to (11). 


Row reduction is also useful in solving homogeneous systems and systems in which 
the number of equations is different from the number of unknowns. 
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Linear Dependence and Independence. A set of k vectors x (1) ,..., x (/c) is said to be linearly 
dependent if there exists a set of real or complex numbers ci,..., c k , at least one of 
which is nonzero, such that 


Cix (1) + • • • + c k x {k) = 0. 


(17) 


In other words, x (1) ,..., x (/c) are linearly dependent if there is a linear relation among 
them. On the other hand, if the only set ci,. .. ,c k for which Eq. (17) is satisfied is 
d = C 2 = • • • = c k = 0, then x (1) ,..., x^ k) are said to be linearly independent. 

Consider now a set of n vectors, each of which has n components. Let x- L j = xf } be 
the ith component of the vector x (j '\ and let X = (x/ 7 ). Then Eq. (17) can be written as 


(x^ci -4-h x^c n \ 

\X^P Cl + • • • + x^c n / 


(xnd + • • • + X\nCy^ 


= 0 , 


\X n iCi + • • • + x nn c n J 


or, equivalently, 

Xc = 0. 


(18) 


If detX 7 b 0, then the only solution of Eq. (18) is c = 0, but if detX = 0, there are 
nonzero solutions. Thus the set of vectors x (1) ,..., x (n) is linearly independent if and 
only if detX 7 ^ 0 . 


EXAMPLE 

3 


Determine whether the vectors 



1\ 


/2\ 


—4\ 

x (1) = 

2 

x (2) = 

1 

x (3) = 

1 


(19) 


are linearly independent or linearly dependent. If they are linearly dependent, find a linear 
relation among them. 

To determine whether x (1) , x (2) , and x (3) are linearly dependent, we seek constants ci, C 2 , and 
c 3 such that 

Cix (1) + c 2 x (2) + c 3 x <3) = 0 . (20) 

Equation (20) can also be written in the form 


1 

2 

— 4\ 



o\ 

2 

1 

1 

C 2 

= 

0 

w 

3 

-IV 

\C3) 


\°> 


( 21 ) 


and solved by means of elementary row operations starting from the augmented matrix 



1 

2 

-4 

°\ 


2 

1 

1 

0 

V 

-1 

3 

-11 

0/ 


We proceed as in Examples 1 and 2. 


( 22 ) 
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(a) Add (—2) times the first row to the second row, and add the first row to the third row. 


1 

2 

-4 

°\ 

0 

-3 

9 

0 

V° 

5 

-15 

V 


(b) Divide the second row by —3; then add (—5) times the second row to the third row. 


h 

2 

-4 

°\ 

0 

1 

-3 

0 

V° 

0 

0 

V 


Thus we obtain the equivalent system 


C\ -b 2 c 2 — 4c3 — 0, 
c 2 — 3c 3 = 0. 


(23) 


From the second of Eqs. (23) we have c 2 = 3c 3 , and then from the first we obtain 
c\ — 4 c 3 — 2c 2 = —2c 3 . Thus we have solved for c\ and c 2 in terms of c 3 , with the latter remain¬ 
ing arbitrary. If we choose c 3 = — 1 for convenience, then c\ — 2 and c 2 = —3. In this case the 
relation (20) becomes 

2x (1) _ 3 x (2) - x (3) = 0, 


and the given vectors are linearly dependent. 

Alternatively, we can compute det (xy), whose columns are the components of x (1) , x (2) , and 
x (3) , respectively. Thus 


detfo,-) = 


1 

2 

-1 


2 -4 
1 1 

3 -11 


and direct calculation shows that it is zero. Hence x (1) , x (2) , and x (3) are linearly dependent. 
However, if the coefficients c 3 , c 2 , and c 3 are required, we still need to solve Eq. (20) to find 
them. 


Frequently, it is useful to think of the columns (or rows) of a matrix A as vectors. 
These column (or row) vectors are linearly independent if and only if det A ^ 0. 
Further, if C = AB, then it can be shown that detC = (det A) (det B). Therefore, if 
the columns (or rows) of both A and B are linearly independent, then the columns 
(or rows) of C are also linearly independent. 

Now let us extend the concepts of linear dependence and independence to a set 
of vector functions x ( 1 ) (0,... ,x^ k \t) defined on an interval a < t < The vectors 
x ( 1 ) (0, • • • ,x^ k \t) are said to be linearly dependent on a < t < /3 if there exists a set 
of constants ci,..., c&, not all of which are zero, such that 

cix (1) (0 4 -b CkX (k \t) = 0 for all t in the interval. 

Otherwise, x ( 1 ) (0,... ,x^ k \t) are said to be linearly independent. Note that if 
x ( 1 ) ( 0 , • • • ,x^ k \t) are linearly dependent on an interval, they are linearly dependent 
at each point in the interval. However, if x ( 1 ) (0,... ,x (/c) (0 are linearly independent 
on an interval, they may or may not be linearly independent at each point; they may, 
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in fact, be linearly dependent at each point, but with different sets of constants at 
different points. See Problem 15 for an example. 

Eigenvalues and Eigenvectors. The equation 

Ax = y (24) 

can be viewed as a linear transformation that maps (or transforms) a given vector x 
into a new vector y. Vectors that are transformed into multiples of themselves are 
important in many applications. 5 To find such vectors, we set y = Xx, where A. is a 
scalar proportionality factor, and seek solutions of the equation 

Ax = Xx, (25) 

or 

(A — Xl)x = 0. (26) 

The latter equation has nonzero solutions if and only if X is chosen so that 

det(A - XT) = 0. (27) 

Equation (27) is a polynomial equation of degree n in A and is called the characteristic 
equation of the matrix A. Values of X that satisfy Eq. (27) may be either real- or 
complex-valued and are called eigenvalues of A. The nonzero solutions of Eq. (25) 
or (26) that are obtained by using such a value of X are called the eigenvectors 
corresponding to that eigenvalue. 

If A is a 2 x 2 matrix, then Eq. (26) is 

( 

and Eq. (27) becomes 

(#11 — X) (#22 — A.) — #12*221 = 0, 

or 

X 2 (#11 + a 2 2 )X + # 11#22 < 2 i 2#21 = 0. (29) 

The following example illustrates how eigenvalues and eigenvectors are found. 


#11 — X #12 \ f x 1 
#21 #22 - V \*2 


( 28 ) 


EXAMPLE 

4 


Find the eigenvalues and eigenvectors of the matrix 



The eigenvalues X and eigenvectors x satisfy the equation (A — AI)x = 0, or 



(30) 


(31) 


5 For example, this problem is encountered in finding the principal axes of stress or strain in an elastic 
body, and in finding the modes of free vibration in a conservative system with a finite number of degrees 
of freedom. 
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The eigenvalues are the roots of the equation 


det(A - 71) 


3-1 

4 


-1 

—2 — 1 


= X 2 — X —2 = (X — 2)(1 + 1) = 0. 


(32) 


Thus the eigenvalues are li = 2 and 1 2 = -1. 

To find the eigenvectors, we return to Eq. (31) and replace 1 by each of the eigenvalues in 
turn. For 1 = 2 we have 



Hence each row of this vector equation leads to the condition x\ — x 2 = 0, so x\ and x 2 are 
equal but their value is not determined. If x\ = c, then x 2 = c also, and the eigenvector x (1) is 


x 


(i) 



c^O. 


(34) 


Thus there is an infinite family of eigenvectors, indexed by the arbitrary constant c, correspond¬ 
ing to the eigenvalue li. We will choose a single member of this family as a representative of 
the rest; in this example it seems simplest to let c = 1. Then, instead of Eq. (34), we write 


x 


(i) 



(35) 


and remember that any nonzero multiple of this vector is also an eigenvector. We say that x (1) 
is the eigenvector corresponding to the eigenvalue X\—2. 

Now, setting 1 = — 1 in Eq. (31), we obtain 



Again we obtain a single condition on x\ and x 2 , namely, 4x\ — x 2 = 0. Thus the eigenvector 
corresponding to the eigenvalue 1 2 = — 1 is 



or any nonzero multiple of this vector. 


As Example 4 illustrates, eigenvectors are determined only up to an arbitrary 
nonzero multiplicative constant; if this constant is specified in some way, then the 
eigenvectors are said to be normalized. In Example 4, we chose the constant c so 
that the components of the eigenvectors would be small integers. However, any 
other choice of c is equally valid, although perhaps less convenient. Sometimes it 
is useful to normalize an eigenvector x by choosing the constant so that its length 
||x|| = (x.x) 1 / 2 = 1. 

Since the characteristic equation (27) for ann x n matrix A is a polynomial equa¬ 
tion of degree n in 7, each such matrix has n eigenvalues 7i, ..., X n , some of which 
may be repeated. If a given eigenvalue appears m times as a root of Eq. (27), then 
that eigenvalue is said to have algebraic multiplicity m. Each eigenvalue has at least 
one associated eigenvector, and an eigenvalue of algebraic multiplicity m may have q 
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linearly independent eigenvectors. The integer q is called the geometric multiplicity 
of the eigenvalue, and it is possible to show that 

1 < q < m. (38) 

Further, examples demonstrate that q may be any integer in this interval. If each 
eigenvalue of A is simple (has algebraic multiplicity 1), then each eigenvalue also has 
geometric multiplicity 1 . 

It is possible to show that if X\ and X 2 are two eigenvalues of A and if X\ 7 ^ X 2 , then 
their corresponding eigenvectors x (1) and x (2) are linearly independent (Problem 34). 
This result extends to any set ki ,..., X^ of distinct eigenvalues: their eigenvectors 
x (1) ,... ,x (/c) are linearly independent. Thus, if each eigenvalue of an n x n matrix 
is simple, then the n eigenvectors of A, one for each eigenvalue, are linearly inde¬ 
pendent. On the other hand, if A has one or more repeated eigenvalues, then there 
may be fewer than n linearly independent eigenvectors associated with A, since for a 
repeated eigenvalue we may have q < m. As we will see in Section 7.8, this fact may 
lead to complications later on in the solution of systems of differential equations. 


EXAMPLE 

5 


Find the eigenvalues and eigenvectors of the matrix 


A = 


/o 1 

1 0 

V 1 1 


1 \ 

1 

0 / 


The eigenvalues X and eigenvectors x satisfy the equation (A — AI)x = 0, or 


-X 

1 

A 

(xA 

o\ 

1 

—X 

1 

*2 = 

0 

1 

1 

-v 

W 

w 


The eigenvalues are the roots of the equation 


det(A - XI) 


-X 1 1 

1 -X 1 
1 1 —X 


-A 3 + 3X + 2 = 0. 


(39) 


(40) 


(41) 


The roots of Eq. (41) are X\ = 2, X 2 = — 1, and X 3 = -1. Thus 2 is a simple eigenvalue, and —1 
is an eigenvalue of algebraic multiplicity 2, or a double eigenvalue. 

To find the eigenvector x (1) corresponding to the eigenvalue X\, we substitute X = 2 in 
Eq. (40); this gives the system 


/-2 1 

1 -2 
1 1 


i\ 

1 


x 2 


-2) \x 3 J 


M 

0 

w 


We can reduce this to the equivalent system 


/2 -1 
0 1 
0 


-1 


(x^ 

x 2 

w 


/ 0 \ 

0 

w 


(42) 


(43) 
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(44) 


by elementary row operations. Solving this system yields the eigenvector 

/ 1 \ 

x (1) = 1 . 

w 

For X = — 1, Eqs. (40) reduce immediately to the single equation 

X\ -\- X 2 + x 3 = 0. (45) 

Thus values for two of the quantities x\, x 2 , x 3 can be chosen arbitrarily, and the third is 
determined from Eq. (45). For example, if x\ = c\ and *2 = c 2 , then x 3 = — c\ — c 2 . In vector 
notation we have 



d \ 


1 ) 


( 0 ^ 

X = 

Cl 

= Cl 

0 

+ C 2 

1 


\ -Cl Cl J 


J 


l - 1 ) 


For example, by choosing c\ = 1 and c 2 = 0, we obtain the eigenvector 

/ 

0 


(46) 


(47) 


-l; 


Any nonzero multiple of x (2) is also an eigenvector, but a second independent eigenvector can 
be found by making another choice of c\ and C 2 —for instance, c\ = 0 and C 2 = 1. In this case 
we obtain 

/ 0 \ 


1 

V-V 


(48) 


which is linearly independent of x (2) . Therefore, in this example, two linearly independent 
eigenvectors are associated with the double eigenvalue. 


An important special class of matrices, called self-adjoint or Hermitian matrices, 
are those for which A* = A; that is, aji — a t j. Hermitian matrices include as a subclass 
real symmetric matrices—that is, matrices that have real elements and for which 
A r = A. The eigenvalues and eigenvectors of Hermitian matrices always have the 
following useful properties: 

1. All eigenvalues are real. 

2. There always exists a full set of n linearly independent eigenvectors, regardless of the 
algebraic multiplicities of the eigenvalues. 

3. If x (1) and x (2) are eigenvectors that correspond to different eigenvalues, then 
(x (1) , x (2) ) = 0. Thus, if all eigenvalues are simple, then the associated eigenvectors form an 
orthogonal set of vectors. 

4. Corresponding to an eigenvalue of algebraic multiplicity m, it is possible to choose m 
eigenvectors that are mutually orthogonal. Thus the full set of n eigenvectors can always 
be chosen to be orthogonal as well as linearly independent. 

The proofs of statements 1 and 3 above are outlined in Problems 32 and 33. Example 
5 involves a real symmetric matrix and illustrates properties 1,2, and 3, but the choice 
we have made for x (2) and x (3) does not illustrate property 4. However, it is always 
possible to choose an x (2) and x (3) so that (x (2) ,x (3) ) = 0. For instance, in Example 5 
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PROBLEMS 


we could have chosen x (2) as before and x (3) by using c\ = 1 and C 2 = —2 in Eq. (46). 
In this way we obtain 


1 \ 

0 

v-v 


1\ 

-2 

V 


as the eigenvectors associated with the eigenvalue k = — 1. These eigenvectors are 
orthogonal to each other as well as to the eigenvector x (1) that corresponds to the 
eigenvalue k = 2 . 


In each of Problems 1 through 6, either solve the given system of equations, or else show that 
there is no solution. 


1. X\ — X 3 = 0 

3x\ + X 2 + *3=1 

— X\ ~b X2 2^3 — 2 

3. xi + 2x 2 — x 3 = 2 
2X\ + X2 + x 3 = 1 

jci — x 2 + 2 x 3 = —1 

5. jti — x 3 = 0 

3xi + x 2 + x 3 — 0 
—jci + x 2 + 2 x 3 = 0 


2. jti + 2 x 2 — x 3 = 1 
2xi + x 2 + x 3 = 1 
jci — x 2 + 2 x 3 = 1 

4. jci + 2x 2 — x 3 = 0 
2xi + x 2 + x 3 = 0 
X\ — x 2 + 2 x 3 = 0 

6. xi + 2 x 2 — x 3 = — 2 
-2xi - 4 x 2 + 2x 3 = 4 
2xi + 4 x 2 - 2x 3 = -4 


In each of Problems 7 through 11, determine whether the members of the given set of vectors 
are linearly independent. If they are linearly dependent, find a linear relation among them. 
The vectors are written as row vectors to save space but may be considered as column vectors; 
that is, the transposes of the given vectors may be used instead of the vectors themselves. 


7. 

x a> 

= (1,1,0), 

x (2) = (0,1,1), 

x (3) = 

(1,0,1) 



8. 

x d) 

= (2,1,0), 

X® = (0,1,0), 

X® = 

(-1,2,0) 



9. 

x d) 

= (1,2,2,3), 

x (2) = (- 1 , 0 , 3 ,: 

1), 

x (3) = (-2,-1,1,0), 

X® 

= (-3,0,-1,3) 

10. 

x a> 

= (1,2,-1,0), 

x (2) = (2,3,1,- 

-1), 

x® = (-1,0,2,2), 

X® 

= (3,-1,1,3) 

11. 

x d) 

= (1,2, -2), 

x® = (3,1,0), 

X® 

= (2,—1,1), x® = 

(4,3,- 

-2) 


12. Suppose that each of the vectors x (1) ,..., x (m) has n components, where n < m. Show that 
x (1) ,..., x (m) are linearly dependent. 

In each of Problems 13 and 14, determine whether the members of the given set of vectors are 
linearly independent for — oo < t < oo. If they are linearly dependent, find the linear relation 
among them. As in Problems 7 through 11, the vectors are written as row vectors to save space. 

13. x (1) (0 = (<r', 20, x (2) (0 = (OO, x (3) (0 = (300) 

14. x (1) (0 = (2 sin t, sin t), x (2) (0 = (sin t, 2 sin t) 
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15. Let 



Show that x (1) (t) and x (2) (0 are linearly dependent at each point in the interval 0 < t < 1. 
Nevertheless, show that x (1) (t) and x (2) (t) are linearly independent on 0 < t < 1. 

In each of Problems 16 through 25, find all eigenvalues and eigenvectors of the given matrix. 




(i 

0 

°\ 


/ 3 

2 

2 \ 

22 . 

2 

1 

- 2 

23. 

1 

4 

1 


0 

2 



l - 2 

-4 




11/9 

-2/9 

8/9\ 


(3 

2 

4\ 

24. 

-2/9 

2/9 

10/9 

25. 

2 

0 

2 


8/9 

10/9 

5/9/ 


l 4 

2 

V 


Problems 26 through 30 deal with the problem of solving Ax = b when det A = 0. 

26. (a) Suppose that A is a real-valued n x n matrix. Show that (Ax,y) = (x,A r y) for any 
vectors x and y. 

Hint: You may find it simpler to consider first the case n = 2; then extend the result to an 
arbitrary value of n. 

(b) If A is not necessarily real, show that (Ax, y) = (x, A*y) for any vectors x and y. 

(c) If A is Hermitian, show that (Ax, y) = (x, Ay) for any vectors x and y. 

27. Suppose that, for a given matrix A, there is a nonzero vector x such that Ax = 0. Show 
that there is also a nonzero vector y such that A*y = 0. 

28. Suppose that det A = 0 and that Ax = b has solutions. Show that (b, y) = 0, where y is any 
solution of A*y = 0. Verify that this statement is true for the set of equations in Example 2. 
Hint: Use the result of Problem 26(b). 

29. Suppose that det A = 0 and that x = x (0) is a solution of Ax = b. Show that if £ is a solution 
of A£ = 0 and a is any constant, then x = x (0) + a% is also a solution of Ax = b. 

30. Suppose that det A = 0 and that y is a solution of A*y = 0. Show that if (b, y) = 0 for every 
such y, then Ax = b has solutions. Note that this is the converse of Problem 28; the form 
of the solution is given by Problem 29. 

Hint: What does the relation A*y = 0 say about the rows of A? Again, it may be helpful 
to consider the case n = 2 first. 
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31. Prove that X = 0 is an eigenvalue of A if and only if A is singular. 

32. In this problem we show that the eigenvalues of a Hermitian matrix A are real. Let x be 
an eigenvector corresponding to the eigenvalue X. 

(a) Show that (Ax, x) = (x, Ax). Hint: See Problem 26(c). 

(b) Show that X(x, x) = X(x, x). Hint: Recall that Ax = Xx. 

(c) Show that X = X; that is, the eigenvalue X is real. 

33. Show that if X\ and X 2 are eigenvalues of a Hermitian matrix A, and if X\ X 2 , then the 
corresponding eigenvectors x (1) and x (2) are orthogonal. 

Hint: Use the results of Problems 26(c) and 32 to show that (A.i - A 2 )(x (1) ,x (2) ) = 0. 

34. Show that if X\ and X 2 are eigenvalues of any matrix A, and if X\ ^ X 2 , then the corre¬ 
sponding eigenvectors x (1) and x (2) are linearly independent. 

Hint: Start from Cix (1) + c 2 x (2) — 0; multiply by A to obtain cAiX (1) + c 2 A 2 x (2) = 0. Then 
show that c\ = c 2 = 0. 


7.4 Basic Theory of Systems of First Order Linear Equations 


The general theory of a system of n first order linear equations 
x[ = Pn(t)xi H-b Pin(t)x n + gi(t), 

x' n = Pnl(t)Xl +- Pnn(t)Xn + gn(t) 


( 1 ) 


closely parallels that of a single linear equation of nth order. The discussion in this 
section therefore follows the same general lines as that in Sections 3.2 and 4.1. 
To discuss the system (1) most effectively, we write it in matrix notation. That is, we 
consider x\ = <pi (t),... ,x n = <f> n (t) to be components of a vector x = 0(7); similarly, 
... ,g n (t) are components of a vector g (t), and pn(t), ... ,p n n(t) are elements of 
an n x n matrix P (t). Equation (1) then takes the form 


x' = P(f)x + g(0- 


( 2 ) 


The use of vectors and matrices not only saves a great deal of space and facilitates 
calculations but also emphasizes the similarity between systems of equations and 
single (scalar) equations. 

A vector x = 0(0 is said to be a solution of Eq. (2) if its components satisfy the sys¬ 
tem of equations (1). Throughout this section we assume that P and g are continuous 
on some interval a < t < /3; that is, each of the scalar functions pn, • • •, Pnn , gi,...,g n 
is continuous there. According to Theorem 7.1.2, this is sufficient to guarantee the 
existence of solutions of Eq. (2) on the interval a < t < 

It is convenient to consider first the homogeneous equation 

x ; = P (t)x (3) 

obtained from Eq. (2) by setting g (t) = 0. Once the homogeneous equation has been 
solved, there are several methods that can be used to solve the nonhomogeneous 
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Theorem 7.4.1 


equation (2); this is taken up in Section 7.9. We use the notation 


x (1) (0 = 

^n(r)^ 
*21 (0 

, x®(0 = 

(x x k(t)\ 
*2 k(t) 


i (0 / 


\Xnk (0/ 


to designate specific solutions of the system (3). Note that Xij(t) = x^\t) refers to 
the /th component of the ;th solution The main facts about the structure of 

solutions of the system (3) are stated in Theorems 7.4.1 to 7.4.5. They closely resemble 
the corresponding theorems in Sections 3.2 and 4.1; some of the proofs are left to 
you as exercises. 


If the vector functions x (1) and x (2) are solutions of the system (3), then the linear 
combination cix (1) + C 2 X (2) is also a solution for any constants c\ and C 2 - 


This is the principle of superposition; it is proved simply by differentiating 
cix (1) + C 2 X (2) and using the fact that x (1) and x (2) satisfy Eq. (3). As an example, 
it can be verified that 


r (D 


(0 


-G2K 


s®(f) = 


e 

—2e 


T(i 


satisfy the equation 



Then, according to Theorem 7.4.1, 


x = c Q e* + c 2 (_‘) 
= cix (1) (r) + c 2 x (2) (r) 


( 5 ) 

( 6 ) 


( 7 ) 


also satisfies Eq. (6). 

By repeated application of Theorem 7.4.1, we can conclude that if x (1) ,..., x (/:) are 
solutions of Eq. (3), then 

x = Cix (1) (?) + •••+ c k \ m ( t ) (8) 


is also a solution for any constants ci,... ,c^. Thus every finite linear combination 
of solutions of Eq. (3) is also a solution. The question that now arises is whether all 
solutions of Eq. (3) can be found in this way. By analogy with previous cases, it is 
reasonable to expect that for the system (3) of n first order equations, it is sufficient to 
form linear combinations of n properly chosen solutions. Therefore, let x (1) ,... ,x (w) 
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Theorem 7.4.2 


be n solutions of the system (3), and consider the matrix X(t) whose columns are the 
vectors x (1) (t),... ,x {n \t)\ 


X(0 = 


/xy\(t) ■ 

•• Xu(t)\ 

Ww • 

* * x nn (t) J 


( 9 ) 


Recall from Section 7.3 that the columns of X(t) are linearly independent for a given 
value of t if and only if detX ^ 0 for that value of t. This determinant is called the 
Wronskian of the n solutions x (1) ,... ,x (n) and is also denoted by W[x (1) ,...,x^j; 
that is, 

W[x a \...,x (n) ](t) = detX(r). (10) 

The solutions x (1) ,... ,x (w) are then linearly independent at a point if and only if 
W[ x (1) ,..., x (n) ] is not zero there. 


If the vector functions x (1) ,... ,x (w) are linearly independent solutions of the sys¬ 
tem (3) for each point in the interval a < t < then each solution x = 0(0 of the 
system (3) can be expressed as a linear combination of x (1) ,..., x (w) 

0(0 = ClX (1) (0 4-h C n x (n \t) (11) 

in exactly one way. 


Before proving Theorem 7.4.2, note that according to Theorem 7.4.1, all expres¬ 
sions of the form (11) are solutions of the system (3), while by Theorem 7.4.2 all 
solutions of Eq. (3) can be written in the form (11). If the constants ci,... ,c w are 
thought of as arbitrary, then Eq. (11) includes all solutions of the system (3), and it is 
customary to call it the general solution. Any set of solutions x (1) ,..., x (n) of Eq. (3) 
that is linearly independent at each point in the interval a < t < is said to be a 
fundamental set of solutions for that interval. 

To prove Theorem 7.4.2, we will show that any solution 0 of Eq. (3) can be written 
as 0(0 = cix (1) (0 + • • • + c n x^(t) for suitable values of ci,..., c n . Let t = to be some 
point in the interval a < t < /3 and let § = 0(0)- We now wish to determine whether 

there is any solution of the form x = cix (1) (0 H-b c n x^ n \t) that also satisfies the 

same initial condition x(t 0 ) = £• That is, we wish to know whether there are values of 
ci,... ,c n such that 

Cix (1) (?o) 4- • • • 4- C n x (n) (t 0 ) = S, (12) 

or, in scalar form, 


cixn(to) + • • • + c n xi n (to) — §i, 


ClX n i(to) T ■ ’ ■ T Cn.X n n(t o) — ^n- 


(13) 


The necessary and sufficient condition that Eqs. (13) possess a unique solution 
ci,... ,c n is precisely the nonvanishing of the determinant of coefficients, which is 
the Wronskian W[ x (1) ,..., x (w) ] evaluated at t — to. The hypothesis that x (1) ,..., x (n) 
are linearly independent throughout a < t < /3 guarantees that W[x (1) ,... ,x (n) ] is 
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Theorem 7.4.3 


Theorem 7.4.4 


not zero at t = to, and therefore there is a (unique) solution of Eq. (3) of the form 
x = cix ( 1 ) (t) + • •• + c w x (w) (0 that also satisfies the initial condition (12). By the 
uniqueness part of Theorem 7.1.2, this solution is identical to 0(t), and hence 
0(0 = cix (1) (0 + • • • + c„x (n) ( 0 , as was to be proved. 


If x (1) ,..., x (w) are solutions of Eq. (3) on the interval a < t < then in this interval 
W[x (1) ,..., x (w) ] either is identically zero or else never vanishes. 


The significance of Theorem 7.4.3 lies in the fact that it relieves us of the necessity 
of examining W[x (1) ,... ,x ( ^] at all points in the interval of interest and enables us 
to determine whether x (1) ,... ,x (w) form a fundamental set of solutions merely by 
evaluating their Wronskian at any convenient point in the interval. 

Theorem 7.4.3 is proved by first establishing that the Wronskian of x (1) ,... ,x ( ^ 
satisfies the differential equation (see Problem 2) 

dW 

-Jj- = [pil(0 +P 22 W + • • • +Pnn( t)]W. (14) 

Hence 

W(t) = cexp |y [p\ 1 (t) H-+/W0]<frj , (15) 

where c is an arbitrary constant, and the conclusion of the theorem follows imme¬ 
diately. The expression for W(t) in Eq. (15) is known as Abel’s formula; note the 
similarity of this result to Theorem 3.2.7 and especially to Eq. (23) of Section 3.2. 

Alternatively, Theorem 7.4.3 can be established by showing that if n solu¬ 
tions x (1) ,... ,x (n) of Eq. (3) are linearly dependent at one point t = to, then they 
must be linearly dependent at each point in a < t < /3 (see Problem 8). Conse¬ 
quently, if x (1) ,..., x (n) are linearly independent at one point, they must be linearly 
independent at each point in the interval. 

The next theorem states that the system (3) always has at least one fundamental 
set of solutions. 


Let 




1 

0 


f 1 

1 


0 c 

0 • • • C 

, e (2) = 

0 • • • c 

II 

0 


further, let x (1) ,... ,x (n) be the solutions of the system (3) that satisfy the initial 
conditions 

x (1) (?o) = e (1) , x <»>(fo) = e<">, (16) 

respectively, where to is any point in a < t < Then x (1) ,... ,x (n) form a funda¬ 
mental set of solutions of the system (3). 
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Theorem 7.4.5 


PROBLEMS 


To prove this theorem, note that the existence and uniqueness of the solutions 
x (1) ,... ,x (w) mentioned in Theorem 7.4.4 are ensured by Theorem 7.1.2. It is not 
hard to see that the Wronskian of these solutions is equal to 1 when t = to ; therefore 
x (1) ,..., x (n) are a fundamental set of solutions. 

Once one fundamental set of solutions has been found, other sets can be gener¬ 
ated by forming (independent) linear combinations of the first set. For theoretical 
purposes, the set given by Theorem 7.4.4 is usually the simplest. 

Finally, it may happen (just as for second order linear equations) that a system 
whose coefficients are all real may give rise to solutions that are complex-valued. 
In this case, the following theorem is analogous to Theorem 3.2.6 and enables us to 
obtain real-valued solutions instead. 


Consider the system (3) 

x' = P (r)x, 

where each element of P is a real-valued continuous function. If x = u (t) + iv(t) is 
a complex-valued solution of Eq. (3), then its real part u it) and its imaginary part 
v(t) are also solutions of this equation. 


To prove this result, we substitute u(t) + i\(t) for x in Eq. (3), thereby obtaining 

x' - P(0x = u \t) — P(f)u(0 + i [v'(0 - P(f)v(0] = 0. (17) 

We have used the assumption that P (t) is real-valued to separate Eq. (17) into 
its real and imaginary parts. Since a complex number is zero if and only if its 
real and imaginary parts are both zero, we conclude that u'(t) — P(t)u(t) = 0 and 
v'(0 — P (t)\(t) = 0. Therefore, u (t) and y(t) are solutions of Eq. (3). 

To summarize the results of this section: 

1. Any set of n linearly independent solutions of the system x' = P (t)x constitutes a 
fundamental set of solutions. 

2. Under the conditions given in this section, such fundamental sets always exist. 

3. Every solution of the system x' = F(t)x can be represented as a linear combination of any 
fundamental set of solutions. 


1. Prove the generalization of Theorem 7.4.1, as expressed in the sentence that includes 
Eq. (8), for an arbitrary value of the integer k. 

2. In this problem we outline a proof of Theorem 7.4.3 in the case n = 2. Let x (1) and x (2) 
be solutions of Eq. (3) for a < t < /?, and let W be the Wronskian of x (1) and x (2) . 

(a) Show that 


dx ( ^ 

dxf> 



*?> 

dt 

x a) 

dt 

x (2) 

+ 

dx 2 X) 

dx? 


dt 

dt 
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(b) Using Eq. (3), show that 

dW 

—77" — (/hi + /?22)W. 
at 

(c) Find W(t) by solving the differential equation obtained in part (b). Use this expression 
to obtain the conclusion stated in Theorem 7.4.3. 

(d) Prove Theorem 7.4.3 for an arbitrary value of n by generalizing the procedure of parts 

(a), (b), and (c). 

3. Show that the Wronskians of two fundamental sets of solutions of the system (3) can differ 
at most by a multiplicative constant. 

Hint: Use Eq. (15). 

4. If xi = y and x 2 = /, then the second order equation 

f+p(t)? + q(f)y = 0 (i) 


corresponds to the system 


x[ = x 2 , 

x' 2 = ~q(t)x 1 -p(t)x 2 . (h) 

Show that if x (1) and x (2) are a fundamental set of solutions of Eqs. (ii), and if y (1) and y (2) 
are a fundamental set of solutions of Eq. (i), then TT[y (1) ,y (2) ] = cTT[x (1) , x (2) ], where c is a 
nonzero constant. 

Hint:y (1 \t) and y (2) (0 must be linear combinations of Xn(t) and * 12 (0- 

5. Show that the general solution of x' = P (t)x + g(?) is the sum of any particular solution x (p) 
of this equation and the general solution x (c) of the corresponding homogeneous equation. 

6. Consider the vectors x (1) (t) = andx (2) (t) = 

(a) Compute the Wronskian of x (1) and x (2) . 

(b) In what intervals are x (1) and x (2) linearly independent? 

(c) What conclusion can be drawn about the coefficients in the system of homogeneous 
differential equations satisfied by x (1) and x (2) ? 

(d) Find this system of equations and verify the conclusions of part (c). 

7. Consider the vectors x (1) ® = L ) and x (2) (t) = y t V and answer the same questions as 

in Problem 6. ' ^ ' 

The following two problems indicate an alternative derivation of Theorem 7.4.2. 

8 . Let x (1) ,... ,x (m) be solutions of x' = P (t)x on the interval a < t < /3. Assume that P is 
continuous, and let to be an arbitrary point in the given interval. Show that x (1) ,... ,x (m) 
are linearly dependent for a < t < /3 if (and only if) x (1) (t 0 ),..., x (m) (t 0 ) are linearly depen¬ 
dent. In other words x (1) ,..., x (m) are linearly dependent on the interval (a, p) if they are 
linearly dependent at any point in it. 

Hint: There are constants ci,...,c m that satisfy cix (1) (t 0 ) H-b c m x (m) (t 0 ) = 0. Let 

z (t) = cix (1) ® H-b c m x (m) (t), and use the uniqueness theorem to show that z (t) = 0 

for each t in a < t < ft. 

9. Let x (1) ,..., x (n) be linearly independent solutions of x' = P (t)x, where P is continuous on 
a < t < p. 
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(a) Show that any solution x = z (t) can be written in the form 


z (t) = cix (1) (0 H-b c n x (n \t) 


for suitable constants c 1? ..., c n . 

Hint: Use the result of Problem 12 of Section 7.3, and also Problem 8 above. 

(b) Show that the expression for the solution z (t) in part (a) is unique; that is, if 
z (t) = kix (1 \t) -\ -b k n x (n) (t), then k\ = ci,... ,k n — c n . 

Hint: Show that ( k\ — Ci)x (1) (t) H-b (k n — c n )x (n) (t) = 0 for each tin a < t < /?, and use 

the linear independence of x (1) ,... ,x (n) . 


7.5 Homogeneous Linear Systems with Constant Coefficients 


We will concentrate most of our attention on systems of homogeneous linear 
equations with constant coefficients—that is, systems of the form 

x' = Ax, (1) 

where A is a constant «xw matrix. Unless stated otherwise, we will assume further 
that all the elements of A are real (rather than complex) numbers. 

If n = 1, then the system reduces to a single first order equation 

dx ^ 

*= <2) 

whose solution is x = ce at . Note that x = 0 is the only equilibrium solution if a ^ 0. 
If a < 0, then other solutions approach x = 0 as t increases, and in this case we say 
that x = 0 is an asymptotically stable equilibrium solution. On the other hand, if 
a > 0, then x = 0 is unstable, since other solutions depart from it with increasing t. 
For systems of n equations, the situation is similar but more complicated. Equilibrium 
solutions are found by solving Ax = 0. We usually assume that det A ^ 0, so x = 0 
is the only equilibrium solution. An important question is whether other solutions 
approach this equilibrium solution or depart from it as t increases; in other words, is 
x = 0 asymptotically stable or unstable? Or are there still other possibilities? 

The case n = 2 is particularly important and lends itself to visualization in the 
X 1 X 2 -plane, called the phase plane. By evaluating Ax at a large number of points 
and plotting the resulting vectors, we obtain a direction field of tangent vectors to 
solutions of the system of differential equations. A qualitative understanding of the 
behavior of solutions can usually be gained from a direction field. More precise 
information results from including in the plot some solution curves, or trajectories. 
A plot that shows a representative sample of trajectories for a given system is called 
a phase portrait. A well-constructed phase portrait provides easily understood infor¬ 
mation about all solutions of a two-dimensional system in a single graphical display. 
Although creating quantitatively accurate phase portraits requires computer assis¬ 
tance, it is usually possible to sketch qualitatively accurate phase portraits by hand, 
as we demonstrate in Examples 2 and 3 below. 
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Our first task, however, is to show how to find solutions of systems such as Eq. (1). 
We start with a particularly simple example. 


EXAMPLE 

1 


Find the general solution of the system 



The most important feature of this system is that the coefficient matrix is a diagonal matrix. 
Thus, by writing the system in scalar form, we obtain 

x[ = 2x\, x' 2 = —3x2. 

Each of these equations involves only one of the unknown variables, so we can solve the two 
equations separately. In this way we find that 

2 1 - 3 1 

X\ = c\e , x 2 = c 2 e , 


where c\ and C 2 are arbitrary constants. Then, by writing the solution in vector form, we have 


c\e 1 
c 2 e~ 3t 


■■ c i 


+ c 2 


■■ C 1 


Now we define the two solutions x (1) and x (2) so that 




x^(t) = 

The Wronskian of these solutions is 

W[x (1) ,x (2) ](0 = 


x ®(0 = 


c 2r 0 
0 e~ 3t 


= e 


e 2t + c 2 


a -31 


„- 31 


( 4 ) 


( 5 ) 


( 6 ) 


which is never zero. Therefore, x (1) and x (2) form a fundamental set of solutions, and the 
general solution of Eq. (3) is given by Eq. (4). 


In Example 1 we found two independent solutions of the given system (3) in 
the form of an exponential function multiplied by a vector. This was perhaps to be 
expected since we have found other linear equations with constant coefficients to 
have exponential solutions, and the unknown x in the system (3) is a vector. So let us 
try to extend this idea to the general system (1) by seeking solutions of the form 

X = (7) 

where the exponent r and the vector § are to be determined. Substituting from Eq. (7) 
for x in the system (1) gives 

r%e n = A $e rt . 

Upon canceling the nonzero scalar factor e rt , we obtain A§ = r§, or 

(A - rl)$ = 0, (8) 

where I is the n x n identity matrix. Thus, to solve the system of differential equa¬ 
tions (1), we must solve the system of algebraic equations (8). This latter problem is 
precisely the one that determines the eigenvalues and eigenvectors of the matrix A. 
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Therefore, the vector x given by Eq. (7) is a solution of Eq. (1), provided that r is an 
eigenvalue and § an associated eigenvector of the coefficient matrix A. 

The following two examples are typical of 2 x 2 systems with eigenvalues that are 
real and different. In each example we will solve the system and construct a corre¬ 
sponding phase portrait. We will see that solutions have very distinct geometrical 
patterns depending on whether the eigenvalues have the same sign or different signs. 
Later in the section we return to a further discussion of the general system. 

Consider the system 


EXAMPLE 



2 


(9) 


Plot a direction field and determine the qualitative behavior of solutions. Then find the general 
solution and draw a phase portrait showing several trajectories. 

A direction field for this system is shown in Figure 7.5.1. By following the arrows in this 
figure, you can see that a typical solution in the second quadrant eventually moves into the 
first or third quadrant, and likewise for a typical solution in the fourth quadrant. On the 
other hand, no solution leaves either the first or the third quadrant. Further, it appears that 
a typical solution departs from the neighborhood of the origin and ultimately has a slope of 
approximately 2. 



////////✓✓ *'^^^^\\\ \ t 1 

FIGURE 7.5.1 Direction field for the system (9). 


To find solutions explicitly, we assume that x = %e rt and substitute for x in Eq. (9). We are 
led to the system of algebraic equations 
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Equations (10) have a nontrivial solution if and only if the determinant of coefficients is zero. 
Thus, allowable values of r are found from the equation 


1 — r 1 
4 1 — r 


(1 -r) 2 - 4 


= r 2 -2r-3 = (r- 3)(r + 1) = 0. (11) 


Equation (11) has the roots r\ — 3 and r 2 = —1; these are the eigenvalues of the coefficient 
matrix in Eq. (9). If r = 3, then the system (10) reduces to the single equation 


—2^i + — 0. 


( 12 ) 


Thus = 2£i, and the eigenvector corresponding to r\ = 3 can be taken as 

! (1) = 

Similarly, corresponding to r 2 = —1, we find that £ 2 = — 2£i, so the eigenvector is 

*"-(4 

The corresponding solutions of the differential equation are 


x w (0 = 

The Wronskian of these solutions is 

W[x (1 \x <2) ](r) = 


x (2) (0 = 


2e 3t —2e~ 


1 

-2 


= —4e 2 ', 


(13) 


(14) 


(15) 


(16) 


which is never zero. Hence the solutions x (1) and x (2) form a fundamental set, and the general 
solution of the system (9) is 


X = ClX (1) (0+C 2 X W (0 


( 2 )/ 


= ci d I e* + c 2 


1 

-2 


e , 


(17) 


where ci and c 2 are arbitrary constants. 

To visualize the solution (17), it is helpful to consider its graph in the xix 2 -plane for various 
values of the constants c\ and c 2 . We start with x = cix (1) (t) or, in scalar form, 

X\ = cie 3t , x 2 = 2c\e 3t . 

By eliminating t between these two equations, we see that this solution lies on the straight line 
x 2 = 2x\ ; see Figure 1.5.2a. This is the line through the origin in the direction of the eigenvector 
£ (1) . If we look on the solution as the trajectory of a moving particle, then the particle is in the 
first quadrant when c\ > 0 and in the third quadrant when c\ < 0. In either case the particle 
departs from the origin as t increases. Next consider x = c 2 x (2) (d), or 

X\ = c 2 e~\ x 2 = —2 c 2 e~ f . 
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This solution lies on the line x 2 = —2x\, whose direction is determined by the eigenvector £ (2) . 
The solution is in the fourth quadrant when c 2 > 0 and in the second quadrant when c 2 < 0, as 
shown in Figure 1.5.2a. In both cases the particle moves toward the origin as t increases. The 
solution (17) is a combination of x (1) (t) and x (2) (t). For large t the term cix (1) (t) is dominant 
and the term c 2 x (2) ( t ) becomes negligible. Thus all solutions for which c\ ^ 0 are asymptotic to 
the line x 2 = 2xi as t 00 . Similarly, all solutions for which c 2 7 ^ 0 are asymptotic to the line 
x 2 = —2xi as t — 00 . A phase portrait for the system including the graphs of several solutions 
is shown in Figure 1.5.2a. The pattern of trajectories in this figure is typical of all 2 x 2 systems 
x' = Ax for which the eigenvalues are real and of opposite signs. The origin is called a saddle 
point in this case. Saddle points are always unstable because almost all trajectories depart 
from them as t increases. 



FIGURE 7.5.2 (a) A phase portrait for the system (9); the origin is a saddle point. 

(b) Typical plots of x\ versus t for the system (9). 


In the preceding paragraph, we have described how to draw by hand a qualitatively correct 
sketch of the trajectories of a system such as Eq. (9), once the eigenvalues and eigenvectors 
have been determined. However, to produce a detailed and accurate drawing, such as Figure 
1.5.2a and other figures that appear later in this chapter, a computer is extremely helpful, if 
not indispensable. 

As an alternative to Figure 1.5.2a , you can also plot x\ or x 2 as a function of t ; some typical 
plots of X\ versus t are shown in Figure 1.5.2b, and those of x 2 versus t are similar. For certain 
initial conditions it follows that ci = OinEq. (17), so that x\ — c 2 c _? andxi Oast ^ 00. One 
such graph is shown in Figure 1.5.2b , corresponding to a trajectory that approaches the origin in 
Figure 1.5.2a. For most initial conditions, however, c\ ^ 0 and x\ is given by x\ — Cie 3t + c 2 c _r . 
Then the presence of the positive exponential term causes x\ to grow exponentially in mag¬ 
nitude as t increases. Several graphs of this type are shown in Figure 1.5.2b , corresponding to 
trajectories that depart from the neighborhood of the origin in Figure 1.5.2a. It is important to 
understand the relation between parts {a) and ( b ) of Figure 7.5.2 and other similar figures that 
appear later, since you may want to visualize solutions either in the x\x 2 -plane or as functions 
of the independent variable t. 
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EXAMPLE 

3 


Consider the system 




(18) 


Draw a direction field for this system and find its general solution. Then plot a phase portrait 
showing several typical trajectories in the phase plane. 

The direction field for the system (18) in Figure 7.5.3 shows clearly that all solutions approach 
the origin. To find the solutions, we assume that x = %e rt ; then we obtain the algebraic system 


-3-r V2\/§A/0\ 

s /2 -2 -r)\h) \0j' 

The eigenvalues satisfy 

(-3 - r>(—2 - r) - 2 = r 2 + 5r + 4 


(19) 


= (r + l)(r + 4) = 0, 


( 20 ) 


so r\ = —1 and r 2 = —4. For r = —1, Eq. (19) becomes 


-2 s /2 

s /2 -1 


( 21 ) 


Hence §2 = V2§i, and the eigenvector £ (1) corresponding to the eigenvalue r { = —1 can be 
taken as 

' 1 




s/2 r 


( 22 ) 


Similarly, corresponding to the eigenvalue r 2 = —4 we have £1 = —\fl § 2 , so the eigenvector is 

(«) 


^( 2 ) _ 


1 


Thus a fundamental set of solutions of the system (18) is 


x (1) « = 




x®(0 = 


- s /2 

1 


(24) 



FIGURE 7.5.3 Direction field for the system (18). 
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and the general solution is 


X = C\X 


( 1 ) 


(0 + C 2 X (2) = Cl 




+ C 2 


-V2 

1 


(25) 


A phase portrait for the system (18) is constructed by drawing graphs of the solution (25) 
for several values of c\ and c 2 , as shown in Figure 7.5.4a. The solution x (1) (t) approaches 
the origin along the line x 2 = y/2x\, and the solution x (2) (t) approaches the origin along the 
line x\ — —\flx 2 . The directions of these lines are determined by the eigenvectors § (1) and 
£ (2) , respectively. In general, we have a combination of these two fundamental solutions. As 
t -> oo, the solution x (2) (t) is negligible compared to x (1) (t). Thus, unless ci = 0, the solution 
(25) approaches the origin tangent to the line x 2 = *j2x\. The pattern of trajectories shown 
in Figure 7.5.4a is typical of all 2 x 2 systems x' = Ax for which the eigenvalues are real, 
different, and of the same sign. The origin is called a node for such a system. If the eigenvalues 
were positive rather than negative, then the trajectories would be similar but traversed in 
the outward direction. Nodes are asymptotically stable if the eigenvalues are negative and 
unstable if the eigenvalues are positive. 



FIGURE 7.5.4 (a) A phase portrait for the system (18); the origin is an asynptotically 

stable node, (b) Typical plots of x\ versus t for the system (18). 


Although Figure 7.5.4a was computer-generated, a qualitatively correct sketch of the tra¬ 
jectories can be drawn quickly by hand on the basis of a knowledge of the eigenvalues and 
eigenvectors. 

Some typical plots of x\ versus t are shown in Figure 1.5.4b. Observe that each of the 
graphs approaches the t-axis asymptotically as t increases, corresponding to a trajectory that 
approaches the origin in Figure 7.5.2 a. The behavior of x 2 as a function of t is similar. 


Examples 2 and 3 illustrate the two main cases for 2 x 2 systems having eigenvalues 
that are real and different. The eigenvalues have either opposite signs (Example 2) 
or the same sign (Example 3). The other possibility is that zero is an eigenvalue, 
but in this case it follows that det A = 0, which violates the assumption made at the 
beginning of this section. However, see Problems 7 and 8. 
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Returning to the general system (1), we proceed as in the examples. To find solu¬ 
tions of the differential equation (1), we must find the eigenvalues and eigenvectors 
of A from the associated algebraic system (8). The eigenvalues r\,...,r n (which need 
not all be different) are roots of the nth degree polynomial equation 

det(A — rl) = 0. (26) 

The nature of the eigenvalues and the corresponding eigenvectors determines the 
nature of the general solution of the system (1). If we assume that A is a real-valued 
matrix, then we must consider the following possibilities for the eigenvalues of A: 


1. All eigenvalues are real and different from each other. 

2. Some eigenvalues occur in complex conjugate pairs. 

3. Some eigenvalues, either real or complex, are repeated. 


If the n eigenvalues are all real and different, as in the three preceding examples, 
then associated with each eigenvalue r/ is a real eigenvector and the n eigen¬ 
vectors § (1) ,... ,§ (n) are linearly independent. The corresponding solutions of the 
differential system (1) are 

x (1) (0 = £ (1 V l( , x (n) (t) = % (n) e r " t . (27) 

To show that these solutions form a fundamental set, we evaluate their Wronskian: 


W[x (1) ,...,x w ](0 


(n)i 


e n ‘ 






0 ir\+---+r n )t 

& 



& 





in) 


in) 


(28) 


First, we observe that the exponential function is never zero. Next, since the eigen¬ 
vectors § (1) ,... ,§ (w) are linearly independent, the determinant in the last term of 
Eq. (28) is nonzero. As a consequence, the Wronskian W[x (1) ,... ,x ( ^](t) is never 
zero; hence x (1) 
solution of Eq. (1) is 


,x w form a fundamental set of solutions. Thus the general 


x = ci£ (1 V 1? + -- 


+ C n l; 


in) e r n t 


(29) 


If A is real and symmetric (a special case of Hermitian matrices), recall from Sec¬ 
tion 7.3 that all the eigenvalues r \,..., r n must be real. Further, even if some of the 
eigenvalues are repeated, there is always a full set of n eigenvectors § (1) ,..., § (n) that 
are linearly independent (in fact, orthogonal). Hence the corresponding solutions of 
the differential system (1) given by Eq. (27) again form a fundamental set of solutions, 
and the general solution is again given by Eq. (29). The following example illustrates 
this case. 


Find the general solution of 


■ 

EXAMPLE 


(0 

1 

1\ 


4 

x' = 

1 

0 

1 




l 1 

1 

0/ 


x. 


(30) 
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Observe that the coefficient matrix is real and symmetric. The eigenvalues and eigenvectors 
of this matrix were found in Example 5 of Section 7.3: 


r \ = 2 , = 


m 

i 

W 







o\ 

r 2 = -1, 

r 3 = -1; 

5 (2) = 

0 

, S (3) = 

l 


Hence a fundamental set of solutions of Eq. (30) is 


II 

(!) 

1 e 2 ', x®(f) = 

(?) 

1 e~‘, x l3, (t) = 

(?) 


w 

1 

{-v 

1 

l-v 


and the general solution is 



(1\ 




( 0 \ 

X = Cl 

1 

e 2t + c 2 

0 

c r + C3 

1 


(31) 


(32) 


(33) 


(34) 


This example illustrates the fact that even though an eigenvalue (r = —1) has algebraic mul¬ 
tiplicity 2, it may still be possible to find two linearly independent eigenvectors £ (2) and § (3) 
and, as a consequence, to construct the general solution (34). 

The behavior of the solution (34) depends critically on the initial conditions. For large t the 
first term on the right side of Eq. (34) is the dominant one; therefore, if c\ ^ 0, all components 
of x become unbounded as t oo. On the other hand, for certain initial points c\ will be zero. 
In this case, the solution involves only the negative exponential terms, and x 0 as t -> oo. 
The initial points that cause c\ to be zero are precisely those that lie in the plane determined by 
the eigenvectors £ (2) and £ (3) corresponding to the two negative eigenvalues. Thus solutions that 
start in this plane approach the origin as t oo, while all other solutions become unbounded. 


If some of the eigenvalues occur in complex conjugate pairs, then there are still n 
linearly independent solutions of the form (27), provided that all the eigenvalues are 
different. Of course, the solutions arising from complex eigenvalues are complex¬ 
valued. However, as in Section 3.3, it is possible to obtain a full set of real-valued 
solutions. This is discussed in Section 7.6. 

More serious difficulties can occur if an eigenvalue is repeated. In this event the 
number of corresponding linearly independent eigenvectors may be smaller than 
the algebraic multiplicity of the eigenvalue. If so, the number of linearly independent 
solutions of the form %e rt will be smaller than n. To construct a fundamental set 
of solutions, it is then necessary to seek additional solutions of another form. The 
situation is somewhat analogous to that for an nth order linear equation with constant 
coefficients; a repeated root of the characteristic equation gave rise to solutions of 
the form e rt , te rt , t 2 e rt , _The case of repeated eigenvalues is treated in Section 7.8. 

Finally, if A is complex, then complex eigenvalues need not occur in conjugate 
pairs, and the eigenvectors are normally complex-valued even though the associated 
eigenvalue may be real. The solutions of the differential equation (1) are still of the 
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form (27), provided that there are n linearly independent eigenvectors, but in general 
all the solutions are complex-valued. 


PROBLEMS 


In each of Problems 1 through 6: 

(a) Find the general solution of the given system of equations and describe the behavior of 
the solution as t oo. 

(b) Draw a direction field and plot a few trajectories of the system. 


1. x' = 


3 -2 
2 -2 


3. x' = 


41 

* “-(1 J ) 


2. x' = 


2 -1 
3 -2 


41 
41 

41 6. x' = 


4. x' = 


1 -2 

3 -4 

1 

4 -2 

5 3 

4 4 

3 5 

4 4 


In each of Problems 7 and 8: 

(a) Find the general solution of the given system of equations. 

(b) Draw a direction field and a few of the trajectories. In each of these problems, the coef¬ 
ficient matrix has a zero eigenvalue. As a result, the pattern of trajectories is different from 
those in the examples in the text. 






In each of Problems 9 through 14, find the general solution of the given system of equations. 


1 


2 + A 


9. x' = | 



X 


II 

> 

o 

I- 

-1 


X 


/i 

1 

2\ 



3 

2 

4 \ 

11. x! = 

i 

2 

1 

X 

12. x! = 

2 

0 

2 



l 2 

1 

V 



b 

2 

V 


i 

1 

r 



i 

-1 

4^ 


13. x' = 

2 

1 

-i 

X 

14. x! = 

3 

2 

-1 

X 


l - 8 

-5 

-3y 



V 

1 

-h 



In each of Problems 15 through 18, solve the given initial value problem. Describe the behavior 
of the solution as t -> oo. 




i 

1 

2^ 


/2\ 


/ 0 

0 

-A 


/7\ 

17. x' = 

0 

2 

2 

x, x(0) = 

0 

18. x' = 

2 

0 

0 

x, x(0) = 

5 


l- 1 

1 

V 


W 


I ' 1 

2 

V 


w 


19. The system tx' = Ax is analogous to the second order Euler equation (Section 5.4). 
Assuming that x = %t r , where £ is a constant vector, show that £ and r must satisfy 
(A — rl)§ = 0 in order to obtain nontrivial solutions of the given differential equation. 
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Referring to Problem 19, solve the given system of equations in each of Problems 20 through 
23. Assume that t > 0. 


20 . 



22. 




In each of Problems 24 through 27, the eigenvalues and eigenvectors of a matrix A are given. 
Consider the corresponding system x' = Ax. 

(a) Sketch a phase portrait of the system. 

(b) Sketch the trajectory passing through the initial point (2,3). 

(c) For the trajectory in part (b), sketch the graphs of x\ versus t and of x 2 versus t on the 
same set of axes. 


24.n = -l, !“>=(-*); -4 =-2, «“>=(') 

= «»=(-;); * = 2 . = 

2l.n = l, = * = 2, = 


28. Consider a 2 x 2 system x' = Ax. If we assume that r\ ^ r 2 , the general solution is 
x = ci£ (1) e nt + c 2 £ (2 V 2 ^, provided that £ (1) and § (2) are linearly independent. In this prob¬ 
lem we establish the linear independence of £ (1) and £ (2) by assuming that they are linearly 
dependent and then showing that this leads to a contradiction. 

(a) Note that £ (1) satisfies the matrix equation (A — ril)£ (1) = 0; similarly, note that 
(A — r 2 I)£ (2) =0. 

(b) Show that (A - r 2 I)$ (1) = (n - r 2 )£ (1) . 

(c) Suppose that § (1) and £ (2) are linearly dependent. Then ci§ (1) + c 2 £ (2) = 0 and at least 
one of ci and c 2 (say c\) is not zero. Show that (A — r 2 I) (ci£ (1) + c 2 £ (2) ) = 0, and also show 
that (A — r 2 I)(ci£ (1) + c 2 £ (2) ) = Ci(ri — r 2 )£ (1) . Hence c\ = 0, which is a contradiction. 
Therefore, £ (1) and § (2) are linearly independent. 

(d) Modify the argument of part (c) if we assume that c 2 ^ 0. 

(e) Carry out a similar argument for the case in which the order n is equal to 3; note that 
the procedure can be extended to an arbitrary value of n. 


29. Consider the equation 


ay" + by' + cy = 0, 


(i) 


where a , b, and c are constants with a ^ 0. In Chapter 3 it was shown that the general 
solution depended on the roots of the characteristic equation 

ar 2 + br + c = 0. (ii) 

(a) Transform Eq. (i) into a system of first order equations by letting x\ = y,x 2 = y'. Find 
the system of equations x' = Ax satisfied by x = 
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(b) Find the equation that determines the eigenvalues of the coefficient matrix A in 
part (a). Note that this equation is just the characteristic equation (ii) of Eq. (i). 

30. The two-tank system of Problem 22 in Section 7.1 leads to the initial value problem 



where x\ and x 2 are the deviations of the salt levels Q\ and Q 2 from their respective 
equilibria. 

(a) Find the solution of the given initial value problem. 

(b) Plot xi versus t and x 2 versus t on the same set of axes. 

(c) Find the smallest time T such that |xi(0l < 0.5 and |x 2 (t)| < 0.5 for all t > T. 

31. Consider the system 



(a) Solve the system for a = 0.5. What are the eigenvalues of the coefficient matrix? 
Classify the equilibrium point at the origin as to type. 

(b) Solve the system for a = 2. What are the eigenvalues of the coefficient matrix? Classify 
the equilibrium point at the origin as to type. 

(c) In parts (a) and (b), solutions of the system exhibit two quite different types of behav¬ 
ior. Find the eigenvalues of the coefficient matrix in terms of a , and determine the value 
of a between 0.5 and 2 where the transition from one type of behavior to the other occurs. 

Electric Circuits. Problems 32 and 33 are concerned with the electric circuit described by the 
system of differential equations in Problem 21 of Section 7.1: 

/ * _i \ 

L L 

1 1 

V C ~CR~2 

32. (a) Find the general solution of Eq. (i) if Ri = 1 Q, R 2 = f £2, L = 2 H, and C = | F. 

(b) Show that I(t ) 0 and V(t) -> 0 as t — 00 , regardless of the initial values 1(0) and 

V(0). 

33. Consider the preceding system of differential equations (i). 

(a) Find a condition on R l9 R 2 , C, and L that must be satisfied if the eigenvalues of the 
coefficient matrix are to be real and different. 

(b) If the condition found in part (a) is satisfied, show that both eigenvalues are negative. 
Then show that I(t) -> 0 and V(t) -> 0 as t -> 00 , regardless of the initial conditions. 

(c) If the condition found in part (a) is not satisfied, then the eigenvalues are either 
complex or repeated. Do you think that I(t) -> 0 and V(t) 0 as t 00 in these cases 
as well? 

Hint: In part (c), one approach is to change the system (i) into a single second order 
equation. We also discuss complex and repeated eigenvalues in Sections 7.6 and 7.8. 



d I 


dt \ V 
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7.6 Complex Eigenvalues 


In this section we consider again a system of n linear homogeneous equations with 
constant coefficients 

x ; = Ax, (1) 

where the coefficient matrix A is real-valued. If we seek solutions of the form x = %e rt , 
then it follows, as in Section 7.5, that r must be an eigenvalue and § a corresponding 
eigenvector of the coefficient matrix A. Recall that the eigenvalues r \,..., r n of A 
are the roots of the characteristic equation 

det(A - rl) = 0 (2) 

and that the corresponding eigenvectors satisfy 

(A - rl)$ = 0. (3) 

If A is real, then the coefficients in the polynomial equation (2) for r are real, and 
any complex eigenvalues must occur in conjugate pairs. For example, if r\ = X + i/i , 
where X and /x are real, is an eigenvalue of A, then so is r 2 = X — i/i. To explore the 
effect of complex eigenvalues, we begin with an example. 


EXAMPLE 

1 


Find a fundamental set of real-valued solutions of the system 



Plot a phase portrait and graphs of components of typical solutions. 

A direction field for the system (4) is shown in Figure 7.6.1. This plot suggests that the 
trajectories in the phase plane spiral clockwise toward the origin. 

To find a fundamental set of solutions, we assume that 

X = i-e n (5) 

and obtain the set of linear algebraic equations 



for the eigenvalues and eigenvectors of A. The characteristic equation is 

o; m 


therefore the eigenvalues are r x = — \ + / and r 2 = — \ — i. From Eq. (6) a straightforward 
calculation shows that the corresponding eigenvectors are 


? (1) = 




( 8 ) 


Observe that the eigenvectors £ (1) and £ (2) are also complex conjugates. Hence a fundamental 
set of solutions of the system (4) is 


g(-l/2 +i)t 


e (-l/2-i)t' 


X<»(t) = 


X ®(0 = 


( 9 ) 
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x 2 


y y y 
y y y 
/ y y 
/ / / 
/ / I 
/ / \ 


1 - 


/ / / —*► - 

/ / / / ^ - 

/ y y s y y - 

-1— 


—2-’- 

/ / / 

Mi 

i \ 

M 


^ \ \ 


t t i i \ \ \ ■ 
/ / \ \ \ \ N' 
| 1 \ \ \ \ -1 
\ \ \ \ \ W' 
\ \ \ \ \ N V." 
\ \ \ \ \ W ' 
\ \ \ \ XX -2 
\ \ \ X X XX- 
\ \ \ XX XX- 


XX X X 
X X X X 
XX X X 

w \ \ 
w \ \ 
w \ \ 

-X \ \ \ 
X \ \ \ 

N H] 




\ 


\ \ \ \ \ \ 

\ \ \ \ \ \ 

\ \ \ \ \ \ 

\ \ \ \ \ ■ 

\ \ \ v 

\ \ \ \ 

\ \ i i 

i i / / . . 

i / / / / / 

///,// 

-1- 


/ / 


--i- 


✓'z i 


/ / / 2 / /*! 
////// 

^ y y y y / 
y y y y y y 


FIGURE 7.6.1 A direction field for the system (4). 


To obtain a set of real-valued solutions, we can (by Theorem 7.4.5) choose the real and 
imaginary parts of either x (1) or x (2) . In fact, 


x^(0 - 


.-72 


(cos t + i sin t ) = 


e-W 

- P -t /2 


cost 

sint 


+ i 


e -t/2 

,~t /2 


sint 

cost 


( 10 ) 


Hence a set of real-valued solutions of (Eq. 4) is 


u(t) = e 


- p-t !2 


cost 
— sint 


v(t) = e 


- p-t /2 


sint 

cost 


(ii) 


To verify that u(t) and v(t) are linearly independent, we compute their Wronskian: 


TT(u,v)(t) = 


e t/2 cost 
—e~ t/2 sin t 

,2, 


p 1/2 oi 


sint 


p -t /2 


cost 


= e r (cos t + sin t) = e 


The Wronskian W (u, v) (t) is never zero, so it follows that u(t) and v(t) constitute a fundamental 
set of (real-valued) solutions of the system (4). 

The graphs of the solutions u(t) and v(t) are shown in Figure 1.6.2a. Since 


u(0) = 


or 


v(0) = 


the graphs of u(t) and v(t) pass through the points (1,0) and (0,1),respectively. Other solutions 
of the system (4) are linear combinations of u(t) and v(t), and graphs of a few of these solutions 
are also shown in Figure 7.6.2a; this figure is a phase portrait for the system (4). Each trajectory 
approaches the origin along a spiral path as t oo, making infinitely many circuits about the 
origin; this is due to the fact that the solutions (11) are products of decaying exponential and 
sine or cosine factors. Some typical graphs of x\ versus t are shown in Figure 1.6.2b ; each one 
represents a decaying oscillation in time. 
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FIGURE 7.6.2 ( a ) A phase portrait for the system (4); the origin is a spiral point. 

(6) Plots of x\ versus t for the system (4); graphs of *2 versus t are similar. 


Figure 7.6.2a is typical of all 2 x 2 systems x' = Ax whose eigenvalues are complex with 
negative real part. The origin is called a spiral point and is asymptotically stable because all 
trajectories approach it as t increases. For a system whose eigenvalues have a positive real 
part, the trajectories are similar to those in Figure 7.6.2a, but the direction of motion is away 
from the origin, and the trajectories become unbounded. In this case, the origin is unstable. If 
the real part of the eigenvalues is zero, then the trajectories neither approach the origin nor 
become unbounded but instead repeatedly traverse a closed curve about the origin. Examples 
of this behavior can be seen in Figures 7.6.36 and 7.6.46 below. In this case the origin is called 
a center and is said to be stable, but not asymptotically stable. In all three cases, the direction 
of motion may be either clockwise, as in this example, or counterclockwise, depending on the 
elements of the coefficient matrix A. 

The phase portrait in Figure 7.6.2a was drawn by a computer, but it is possible to produce 
a useful sketch of the phase portrait by hand. We have noted that when the eigenval¬ 
ues k ± i/i are complex, then the trajectories either spiral in (k < 0), spiral out (k > 0), or 
repeatedly traverse a closed curve (7 = 0). To determine whether the direction of motion 
is clockwise or counterclockwise, we only need to determine the direction of motion at a 
single convenient point. For instance, in the system (4) we might choose x = (0, 1) T . Then 
Ax = (1, — \) T . Thus at the point (0,1) in the phase plane the tangent vector x' to the tra¬ 
jectory at that point has a positive x\ -component and therefore is directed from the second 
quadrant into the first. The direction of motion is therefore clockwise for the trajectories of 
this system. 


Returning to the general equation (1) 

x' = Ax, 

we can proceed just as in the example. Suppose that there is a pair of complex 
conjugate eigenvalues, r\ =k + ifi and = k — ip. Then the corresponding eigen¬ 
vectors § (1) and § (2) are also complex conjugates. To see that this is so, recall that 
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r\ and § (1) satisfy 

(A-nD$ a > = o. (12) 

On taking the complex conjugate of this equation and noting that A and I are real¬ 
valued, we obtain 

(A — 7iDl (1) — 0, (13) 

where f \ and | (1) are the complex conjugates of r\ and § (1) , respectively. In other 
words, r 2 = f\ is also an eigenvalue, and § (2) = | (1) is a corresponding eigenvector. 
The corresponding solutions 

x a \t) = § (1 V 1? , x (2) (0 = I (1) e 7lt (14) 

of the differential equation (1) are then complex conjugates of each other. Therefore, 
as in Example 1, we can find two real-valued solutions of Eq. (1) corresponding to 
the eigenvalues r\ and r 2 by taking the real and imaginary parts of x ( 1 ) (t) or x ( 2 ) (t) 
given by Eq. (14). 

Let us write § (1 ) — a _j_ fo where a and b are real; then we have 

x (1) (0 = (a + ib)e^ +i ^ 

= (a + zb)e**(cos fit + i sin fit). (15) 

Upon separating x ( 1 ) (t) into its real and imaginary parts, we obtain 

x ( 1 ) (t) = e u (a. cos fit — b sin fit) + ie xt (a sin fit + b cos fit). (16) 

If we write x ( 1 ) (t) = u (t) + i\(t), then the vectors 

u (t) = e kt (a cos fit — b sin fit), 

. (17) 

v (t) = e xt { 2 i sin fit + b cos fit) 

are real-valued solutions of Eq. (1). It is possible to show that u and v are linearly 
independent solutions (see Problem 27). 

For example, suppose that the matrix A has two complex eigenvalues n = A + ifi , 
r 2 = A — ifi, and that r 2 ,..., r n are all real and distinct. Let the corresponding eigen¬ 
vectors be § (1) = a + zb, § (2) = a — zb, § (3) ,..., § {n \ Then the general solution of 
Eq. (1) is 

X = cm(0 + C 2 V(0 + c 3 § (3 V 3 ' + ••• + <:„$ (n) e r "‘, (18) 

where u (t) and v(t) are given by Eqs. (17). We emphasize that this analysis applies 
only if the coefficient matrix A in Eq. (1) is real, for it is only then that complex 
eigenvalues and eigenvectors must occur in conjugate pairs. 

For 2x2 systems with real coefficients, we have now completed our description 
of the three main cases that can occur. 

1. Eigenvalues are real and have opposite signs; x = 0 is a saddle point. 

2. Eigenvalues are real and have the same sign but are unequal; x = 0 is a node. 

3. Eigenvalues are complex with nonzero real part; x = 0 is a spiral point. 
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Other possibilities are of less importance and occur as transitions between two 
of the cases just listed. For example, a zero eigenvalue occurs during the transition 
between a saddle point and a node. Purely imaginary eigenvalues occur during a 
transition between asymptotically stable and unstable spiral points. Finally, real and 
equal eigenvalues appear during the transition between nodes and spiral points. 


The system 

EXAMPLE 

2 



(19) 


contains a parameter a. Describe how the solutions depend qualitatively on a ; in particular, 
find the critical values of a at which the qualitative behavior of the trajectories in the phase 
plane changes markedly. 

The behavior of the trajectories is controlled by the eigenvalues of the coefficient matrix. 
The characteristic equation is 

r 2 - ar + 4 = 0, (20) 


so the eigenvalues are 

a =fc \/a 2 — 16 


( 21 ) 


From Eq. (21) it follows that the eigenvalues are complex conjugates for — 4 < a < 4 and are 
real otherwise. Thus two critical values are a = —4 and a = 4 , where the eigenvalues change 
from real to complex, or vice versa. For a < —4 both eigenvalues are negative, so all trajecto¬ 
ries approach the origin, which is an asymptotically stable node. For a > 4 both eigenvalues 
are positive, so the origin is again a node, this time unstable; all trajectories (except x = 0) 
become unbounded. In the intermediate range, — 4 < a < 4 , the eigenvalues are complex and 
the trajectories are spirals. However, for — 4 < a < 0 the real part of the eigenvalues is 
negative, the spirals are directed inward, and the origin is asymptotically stable, whereas for 
0 < a < 4 the real part of the eigenvalues is positive and the origin is unstable. Thus a = 0 is 
also a critical value where the direction of the spirals changes from inward to outward. For 
this value of a, the origin is a center and the trajectories are closed curves about the origin, 
corresponding to solutions that are periodic in time. The other critical values, a = ± 4 , yield 
eigenvalues that are real and equal. In this case the origin is again a node, but the phase portrait 
differs somewhat from those in Section 7.5. We take up this case in Section 7.8. 


A Multiple Spring-Mass System. Consider the system of two masses and three springs 
shown in Figure 7.1.1, whose equations of motion are given by Eqs. (1) in Section 
7.1. If we assume that there are no external forces, then Fi(t) = 0, F 2 (t) = 0, and the 
resulting equations are 


d 2 x i 

mi ~dF = + ^ 2 * 2 ’ 

d 2 x 2 

m2 ~dfl = klXl ~ + k ^ Xl ’ 


( 22 ) 


These equations can be solved as a system of two second order equations (see 
Problem 29), but, as is consistent with our approach in this chapter, we will transform 
them into a system of four first order equations. Let y\ = x\,y 2 = x 2 , yi = x[, and 
y4 = x' 2 . Then 


y[ = ts , 


= y 4, 


(23) 
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EXAMPLE 

3 


and, from Eqs. (22), 


my' 3 = (k\ + k 2 )yi + k 2 y 2 , m 2 y\ = k 2 yi - (k 2 + k 3 )y 2 . (24) 

The following example deals with a particular case of this two-mass, three-spring 
system. 


Suppose that =2,m 2 = 9/4, k\ = 1, k 2 = 3, and k 3 = 15/4 in Eqs. (23) and (24) so that 

these equations become 

y'i = ys, y' 2 = y*, y' 3 = -2yi + \yi, y' 4 = fyi - 3 y 2 . (25) 

Analyze the possible motions described by Eqs. (25), and draw graphs showing typical 
behavior. 

We can write the system (25) in matrix form as 

/ 0 0 1 

0 0 0 

* = -2 I 0 

I -3 0 


1 

0 

0 / 


y = Ay. 


(26) 


Keep in mind that and are the positions of the two masses, relative to their equilibrium 
positions, and that y 3 and y 4 are their velocities. We assume, as usual, that y = %e rt , where r must 
be an eigenvalue of the matrix A and £ a corresponding eigenvector. It is possible, though a bit 
tedious, to find the eigenvalues and eigenvectors of A by hand, but it is easy with appropriate 
computer software. The characteristic polynomial of A is 


r 4 + 5r 2 + 4 = (r 2 + 1 )(r 2 + 4), 


(27) 


so the eigenvalues are r 3 = i, r 2 = — r 3 = 2 i, and r 4 = —2i. The corresponding eigenvectors 
are 



3\ 


3\ 


3\ 


3 \ 

s (1) = 

2 

3 i 

W 

, l (2) = 

2 

-3 i 
1-2 i) 

? (3) = 

-4 

6i 

£ (4) = 

^ - 

1 1 

00 ^ ^ 


The complex-valued solutions £ (1) e lt and £ (2) e~ u are complex conjugates, so two real-valued 
solutions can be found by finding the real and imaginary parts of either of them. For instance, 
we have 


3 \ 

2 




3 i 

(cos t + i sin 0 

W 




/ 3 cos A 


/ 3 sin A 

2 cos ^ 

+ i 

2sin£ 

—3 sin t 

3 cos t 

^-2 sin 


\2 cos tj 


= u (1) (0 + /v (1) (0- 


(29) 
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In a similar way, we obtain 


(3 ) a 2it _ 




( 3 \ 

-4 

6 / 

V-8 i) 


(cos 2t + i sin 2t) 


/ 3 cos 2 1\ 


/ 3 sin 2 1\ 

-4 cos 2 1 

+ i 

—4 sin 2 1 

—6 sin 2 1 

6 cos 21 

\ 8 sin 2 1) 


y-8cos2 tj 


= u (2) (t) + 


(30) 


We leave it to you to verify that u (1) , v (1) , u (2) , and v (2) are linearly independent and therefore 
form a fundamental set of solutions. Thus the general solution of Eq. (26) is 



/ 3 cos A 


/ 3 sin t\ 


/ 3 cos 2 1\ 


/ 3 sin 2 A 


2 cos t 


2 sin t 


—4 cos 2 1 


—4sin2t 

y = ci 

—3 sin t 

+ c 2 

3 cos t 

+ 

—6 sin 2 1 

+ c 4 

6 cos 2 1 


\—2 sin t) 


\2 cos t) 


\ 8 sin 2t) 


\—8 cos 2 1) 


where c\, c 2 , c 3 , and c 4 are arbitrary constants. 

The phase space for this system is four-dimensional, and each solution, obtained by a par¬ 
ticular set of values for c \,..., c 4 in Eq. (31), corresponds to a trajectory in this space. Since 
each solution, given by Eq. (31), is periodic with period 2jt, each trajectory is a closed curve. 
No matter where the trajectory starts at t = 0, it returns to that point at t = 2 jt, t = 4 tt, and 
so forth, repeatedly traversing the same curve in each time interval of length 2jt. We do not 
attempt to show any of these four-dimensional trajectories here. Instead, in the figures below 
we show projections of certain trajectories in the yyy^- or y 2 y 4 - -plane, thereby showing the 
motion of each mass separately. 

The first two terms on the right side of Eq. (31) describe motions with frequency 1 and period 
27T. Note that y 2 = (2/3)yi in these terms and that y 4 = (2/3)y 3 . This means that the two masses 
move back and forth together, always going in the same direction, but with the second mass 
moving only two-thirds as far as the first mass. If we focus on the solution u (1) (t ) and plot yi 
versus t and y 2 versus t on the same axes, we obtain the cosine graphs of amplitude 3 and 2, 
respectively, shown in Figure 1.6.3a. The trajectory of the first mass in the yiy 3 -plane lies on 
the circle of radius 3 shown in Figure 7.6.3 b, traversed clockwise starting at the point (3,0) 
and completing a circuit in time 2tt. Also shown in this figure is the trajectory of the second 
mass in the y 2 y 4 ' -plane, which lies on the circle of radius 2, also traversed clockwise starting at 
(2,0) and also completing a circuit in time 2tt. The origin is a center in the respective y 3 y 3 - and 
y 2^4 -planes. Similar graphs (with an appropriate shift in time) are obtained from v (1) or from 
a linear combination of u (1) and v (1) . 

The remaining terms on the right side of Eq. (31) describe motions with frequency 2 and 
period jt. Observe that in this case,y 2 = — (4/3)yi andy 4 = —(4/3)y 3 . This means that the two 
masses are always moving in opposite directions and that the second mass moves four-thirds 
as far as the first mass. If we look only at u (2) ( t ) and plot yi versus t and y 2 versus t on the 
same axes, we obtain Figure 7.6.4a. There is a phase difference of tt, and the amplitude of y 2 
is four-thirds that of y 3 , confirming the preceding statements about the motions of the masses. 
Figure 7.6.46 shows a superposition of the trajectories for the two masses in their respective 
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phase planes. Both graphs are ellipses, the inner one corresponding to the first mass and the 
outer one to the second. The trajectory on the inner ellipse starts at (3,0), and the trajectory 
on the outer ellipse starts at (—4,0). Both are traversed clockwise, and a circuit is completed 
in time n. The origin is a center in the respective y\y 2 - and y 2 y 4 - -planes. Once again, similar 
graphs are obtained from v (2) or from a linear combination of u (2) and v (2) . 



FIGURE 7.6.3 (a) A plot of yi versus t and y 2 versus t for the solution 

u ( 1 ) (0- (b) Superposition of projections of trajectories in the 
yiy 3 - and y 2 y 4 --planes for the solution u ( 1 ) ( 0 - 



FIGURE 7.6.4 ( a ) A plot of y 3 versus t and y 2 versus t for the solution 

u (2) (t). ( b ) Superposition of projections of trajectories in the 
yiy 3 - and y 2 y 4 --planes for the solution u ( 2 ) ( 0 - 


The types of motion described in the two preceding paragraphs are called fundamental 
modes of vibration for the two-mass system. Each of them results from fairly special initial 
conditions. For example, to obtain the fundamental mode of frequency 1, both of the con¬ 
stants c 3 and C 4 in Eq. (31) must be zero. This occurs only for initial conditions in which 
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3y 2 (0) = 2yi (0) and 3y 4 (0) = 2y 3 (0). Similarly, the mode of frequency 2 is obtained only when 
both of the constants c\ and c 2 in Eq. (31) are zero—that is, when the initial conditions are 
such that 3y 2 (0) = —4yi(0) and 3y 4 (0) = —4y 3 (0). 

For more general initial conditions the solution is a combination of the two fundamental 
modes. A plot of yi versus t for a typical case is shown in Figure 7.6.5a, and the projection 
of the corresponding trajectory in the yiy 3 -plane is shown in Figure 7.6.56. Observe that this 
latter figure may be a bit misleading in that it shows the projection of the trajectory crossing 
itself. This cannot be the case for the actual trajectory in four dimensions, because it would 
violate the general uniqueness theorem: there cannot be two different solutions issuing from 
the same initial point. 




( 6 ) 

FIGURE 7.6.5 A solution of the system (25) satisfying the 
initial condition y(0) = (—1,4,1, 1 ) T . (a) A plot of yi versus t. ( b ) The 
projection of the trajectory in the y 3 y 3 -plane. As stated in the text, the 
actual trajectory in four dimensions does not intersect itself. 
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PROBLEMS In each of Problems 1 through 6: 

(a) Express the general solution of the given system of equations in terms of real-valued 
functions. 

(b) Also draw a direction field, sketch a few of the trajectories, and describe the behavior of 
the solutions as t -> oo. 


41 

4fi 

41 



41 2. x' = 

41 4. x' = 

41 6. x' = 


-1 -4 

1 -1 

2 -f 
I - 1 . 


-5 -1 


In each of Problems 7 and 8, express the general solution of the given system of equations in 
terms of real-valued functions. 




0 

0 \ 



- 3 

0 

2 \ 


7. x' = 

2 

1 

-2 

X 

8 . x' = 

i 

-1 

0 

X 


l 3 

2 

V 



I - 2 

-1 

V 



In each of Problems 9 and 10, find the solution of the given initial value problem. Describe the 
behavior of the solution as t oo. 



In each of Problems 11 and 12: 

(a) Find the eigenvalues of the given system. 

(b) Choose an initial point (other than the origin) and draw the corresponding trajectory in 
the xix 2 -plane. 

(c) For your trajectory in part (b), draw the graphs of x\ versus t and of x 2 versus t. 

(d) For your trajectory in part (b), draw the corresponding graph in three-dimensional 
tx ix 2 -space. 


41 


11 . x' = 




X 


In each of Problems 13 through 20, the coefficient matrix contains a parameter a. In each of 
these problems: 

(a) Determine the eigenvalues in terms of a. 

(b) Find the critical value or values of a where the qualitative nature of the phase portrait for 
the system changes. 

(c) Draw a phase portrait for a value of a slightly below, and for another value slightly above, 
each critical value. 


-t}' 


41 14. x' = ^ 

4l> 16 - x ' = 



x 


x 
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n **-(_; “)* 

In each of Problems 21 and 22, solve the given system of equations by the method of Problem 
19 of Section 7.5. Assume that t > 0. 



In each of Problems 23 and 24: 

(a) Find the eigenvalues of the given system. 

(b) Choose an initial point (other than the origin) and draw the corresponding trajectory in 
the X\X 2 -plane. Also draw the trajectories in the x\x$- and X 2 X 3 -planes. 

(c) For the initial point in part (b), draw the corresponding trajectory in .* 1 X 2 * 3 -space. 




1 

°\ 



1 

o\ 

41 23. x' = 

-1 

1 

4 

0 

X 24. x' = 

-1 

1 

4 

0 


0 

0 

-v 


0 

0 



25. Consider the electric circuit shown in Figure 7.6.6. Suppose that R\ = R 2 = 4 £ 2 , 
C = \ F, and L = 8 H. 

(a) Show that this circuit is described by the system of differential equations 


d_ 

dt 




(i) 


where I is the current through the inductor and V is the voltage drop across the capacitor. 
Hint: See Problem 20 of Section 7.1. 

(b) Find the general solution of Eqs. (i) in terms of real-valued functions. 

(c) Find I {t) and V (t) if 7(0) = 2 A and V(0) = 3 V. 

(d) Determine the limiting values of I(t) and V(t) as t 00 . Do these limiting values 
depend on the initial conditions? 



FIGURE 7.6.6 The circuit in Problem 25. 

26. The electric circuit shown in Figure 7.6.7 is described by the system of differential equations 


1 1 
\C ~RC / 



d I 


dt \ V 
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where I is the current through the inductor and V is the voltage drop across the capacitor. 
These differential equations were derived in Problem 19 of Section 7.1. 

(a) Show that the eigenvalues of the coefficient matrix are real and different if L > AR 2 C\ 
show that they are complex conjugates if L < AR 2 C. 

(b) Suppose that R = 1£2,C=|F, and L = 1 H. Find the general solution of the 
system (i) in this case. 

(c) Find I (t) and V (t) if 7(0) = 2 A and V (0) = 1V. 

(d) For the circuit of part (b) determine the limiting values of I(t) and V(t) as t oo. Do 
these limiting values depend on the initial conditions? 

C 

r— K —i 

R 

—Wv- '» 

L 

FIGURE 7.6.7 The circuit in Problem 26. 


27. In this problem we indicate how to show that u (t) and v(t), as given by Eqs. (17), are 
linearly independent. Let r\ = X + i/i and f\ = k — i/n be a pair of conjugate eigenvalues of 
the coefficient matrix A of Eq. (1); let £ (1) = a + ib and f (1) = a — ib be the corresponding 
eigenvectors. Recall that it was stated in Section 7.3 that two different eigenvalues have 
linearly independent eigenvectors, so if r\ ^ r \, then £ (1) and | (1) are linearly independent. 

(a) First we show that a and b are linearly independent. Consider the equation 
cia + c 2 b = 0. Express a and b in terms of £ (1) and f (1) , and then show that 
(Cl - ic2 )$ (1) + (Cl + ic 2 ) f (1) = 0 . 

(b) Show that c\ — /c 2 = 0 and c\ + /c 2 = 0 and then that c\ = 0 and c 2 = 0. Consequently, 
a and b are linearly independent. 

(c) To show that u (t) and \(t) are linearly independent, consider the equation 
cilift)) + c 2 vftj) = 0, where to is an arbitrary point. Rewrite this equation in terms of a 
and b, and then proceed as in part (b) to show that ci = 0 and c 2 = 0. Hence u(t) and \(t) 
are linearly independent at the arbitrary point t 0 . Therefore, they are linearly independent 
at every point and on every interval. 

28. A mass m on a spring with constant k satisfies the differential equation (see Section 3.7) 

mu" + ku = 0, 

where u(t) is the displacement at time t of the mass from its equilibrium position. 

(a) Let jti = u,X2 = u' , and show that the resulting system is 


0 1 
-k/m 0 


(b) Find the eigenvalues of the matrix for the system in part (a). 

(c) Sketch several trajectories of the system. Choose one of your trajectories, and sketch 
the corresponding graphs of x\ versus t and x 2 versus t. Sketch both graphs on one set of 
axes. 

(d) What is the relation between the eigenvalues of the coefficient matrix and the natural 
frequency of the spring-mass system? 
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29. Consider the two-mass, three-spring system of Example 3 in the text. Instead of converting 
the problem into a system of four first order equations, we indicate here how to proceed 
directly from Eqs. (22). 

(a) Show that Eqs. (22) can be written in the form 



(i) 


(b) Assume that x = %e rt and show that 

(A - r 2 1)$ = 0. 

Note that r 2 (rather than r ) is an eigenvalue of A corresponding to an eigenvector £. 

(c) Find the eigenvalues and eigenvectors of A. 

(d) Write down expressions for x\ and X 2 . There should be four arbitrary constants in 
these expressions. 

(e) By differentiating the results from part (d), write down expressions for x[ and x' 2 . Your 
results from parts (d) and (e) should agree with Eq. (31) in the text. 

30. Consider the two-mass, three-spring system whose equations of motion are Eqs. (22) in 
the text. Let m 3 = 1, m 2 = 4/3, k\ = 1, k 2 = 3, and k 3 = 4/3. 

(a) As in the text, convert the system to four first order equations of the form y' = Ay. 
Determine the coefficient matrix A. 

(b) Find the eigenvalues and eigenvectors of A. 

(c) Write down the general solution of the system. 

(d) Describe the fundamental modes of vibration. For each fundamental mode draw 
graphs of yi versus t and y 2 versus t. Also draw the corresponding trajectories in the yiy 3 - 
and y 2 ^ 4 -planes. 

(e) Consider the initial conditions y(0) = (2,1,0,0) r . Evaluate the arbitrary constants in 
the general solution in part (c). What is the period of the motion in this case? Plot graphs 
of yi versus t and y 2 versus t. Also plot the corresponding trajectories in the yiy 3 - and 
^ 2 ^ 4 -planes. Be sure you understand how the trajectories are traversed for a full period. 

(f) Consider other initial conditions of your own choice, and plot graphs similar to those 
requested in part (e). 

31. Consider the two-mass, three-spring system whose equations of motion are Eqs. (22) in 
the text. Let m 3 = m 2 = 1 and k\ = k 2 = k 3 = 1. 

(a) As in the text, convert the system to four first order equations of the form y' = Ay. 
Determine the coefficient matrix A. 

(b) Find the eigenvalues and eigenvectors of A. 

(c) Write down the general solution of the system. 

(d) Describe the fundamental modes of vibration. For each fundamental mode draw 
graphs of yi versus t and y 2 versus t. Also draw the corresponding trajectories in the yiy 3 - 
and ^ 2 ^ 4 -planes. 

(e) Consider the initial conditions y(0) = (—1,3,0,0) r . Evaluate the arbitrary constants 
in the general solution in part (c). Plot yi versus t andy 2 versus t. Do you think the solution 
is periodic? Also draw the trajectories in the yiy 3 - and y 2 y 4 -planes. 

(f) Consider other initial conditions of your own choice, and plot graphs similar to those 
requested in part (e). 
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7.7 Fundamental Matrices 


The structure of the solutions of systems of linear differential equations can be 
further illuminated by introducing the idea of a fundamental matrix. Suppose that 
x (1) (t), • • • ,x (n) (t) form a fundamental set of solutions for the equation 



x' = 

P (Ox 

a ) 

on some interval a < t < Then the matrix 



(x^\ t) 

••• 4 n ) ( 0 \ 


*(0 = 

\Xn\t) 

••• Xn n) (t)j 

(2) 

whose columns are the vectors x (1) (7),... 

,x (n) (t ), is said to be a fundamental matrix 


for the system (1). Note that a fundamental matrix is nonsingular since its columns 
are linearly independent vectors. 


Find a fundamental matrix for the system 


EXAMPLE 


1 1 


(3) 


In Example 2 of Section 7.5, we found that 




2c 3? 


x ^(0 = 


-2c“ 


are linearly independent solutions of Eq. (3). Thus a fundamental matrix for the system (3) is 


*(0 = 


2e 3t —2e 


(4) 


The solution of an initial value problem can be written very compactly in terms of 
a fundamental matrix. The general solution of Eq. (1) is 

x = cix (1) (0H-hc„x (n) (0 (5) 


or, in terms of 


x = ty(t) c, 


( 6 ) 


where c is a constant vector with arbitrary components c \,..., c n . For an initial value 
problem consisting of the differential equation (1) and the initial condition 

X(f 0 ) = X°, (7) 

where to is a given point in a < t < /3 and x° is a given initial vector, it is only necessary 
to choose the vector c in Eq. (6) so as to satisfy the initial condition (7). Hence c must 
satisfy 

¥0o)c = X°. 


( 8 ) 
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Therefore, since 0(0) is nonsingular, 


and 


o 

§ 

7 

* 

II 

(9) 

= 'P(0¥ -1 (fo)x° 

(10) 


is the solution of the initial value problem (1), (7). We emphasize, however, that to 
solve a given initial value problem, we would ordinarily solve Eq. (8) by row reduction 
and then substitute for c in Eq. (6), rather than compute O _1 (0) and use Eq. (10). 

Recall that each column of the fundamental matrix O is a solution of Eq. (1). It 
follows that O satisfies the matrix differential equation 


o' = P(0O. 


( 11 ) 


This relation is readily confirmed by comparing the two sides of Eq. (11) column by 
column. 

Sometimes it is convenient to make use of the special fundamental matrix, denoted 
by O(t), whose columns are the vectors x (1) (0,... ,x (w) (0 designated in Theorem 7.4.4. 
Besides the differential equation (1), these vectors satisfy the initial conditions 

x (i) (t 0 ) = e (f> , (12) 

where is the unit vector, defined in Theorem 7.4.4, with a one in the yth position 
and zeros elsewhere. Thus 0(0 has the property that 


0 ( 0 ) = 


(1 

0 


0 

1 



\o 0 ... 1/ 


(13) 


We will always reserve the symbol O to denote the fundamental matrix satisfying the 
initial condition (13) and use O when an arbitrary fundamental matrix is intended. 
In terms of 0(0, the solution of the initial value problem (1), (7) is even simpler in 
appearance; since O _1 (0) = I, it follows from Eq. (10) that 

x = O(0x°. (14) 


Although the fundamental matrix 0(0 is often more complicated than 0(0, it is 
especially helpful if the same system of differential equations is to be solved repeat¬ 
edly subject to many different initial conditions. This corresponds to a given physical 
system that can be started from many different initial states. If the fundamental 
matrix 0(0 has been determined, then the solution for each set of initial condi¬ 
tions can be found simply by matrix multiplication, as indicated by Eq. (14). The 
matrix 0(0 thus represents a transformation of the initial conditions x° into the solu¬ 
tion x(0 at an arbitrary time t. Comparing Eqs. (10) and (14) makes it clear that 
*(0 = ¥( 0 * - 1 0 o ). 
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For the system (3) 

EXAMPLE 

2 



x 


in Example 1, find the fundamental matrix <l> such that <I>(0) = I. 

The columns of 4> are solutions of Eq. (3) that satisfy the initial conditions 

x <1,(0) = Q , X (2) (0) = (Y). (15) 

Since the general solution of Eq. (3) is 



we can find the solution satisfying the first set of these initial conditions by choosing 
Ci = c 2 = \; similarly, we obtain the solution satisfying the second set of initial conditions 
by choosing c\ — \ and c 2 = — Hence 


*(0 = 


l e 3i + l e t 


\e 2t - \e~‘\ 
\e 3t + 


(16) 


Note that the elements of 4>(0 are more complicated than those of the fundamental matrix 
^(0 given by Eq. (4); however, it is now easy to determine the solution corresponding to any 
set of initial conditions. 


The Matrix exp(A t). Recall that the solution of the scalar initial value problem 

x! — ax , %(0) = jcq, (17) 


where a is a constant, is 

x = xoQxp(at). (18) 

Now consider the corresponding initial value problem for an n x n system, namely, 

x' = Ax, x(0) = x°, (19) 

where A is a constant matrix. Applying the results of this section to the problem (19), 
we can write its solution as 

X = $(0x°, (20) 

where <I>(0) = I. Comparing the problems (17) and (19), and their solutions, sug¬ 
gests that the matrix 4>(0 might have an exponential character. We now explore this 
possibility. 

The scalar exponential function exp (at) can be represented by the power series 


exp (at) = 1 + jb a -'y, (21) 

n=\ 

which converges for all t. Let us now replace the scalar a by the n x n constant matrix 
A and consider the corresponding series 


I+ E 


A"r' 


n —1 


n\ 


A 2 t 2 A n t n 

= I + A t H———h • • • H-;—h 


2 ! 


n\ 


( 22 ) 
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Each term in the series (22) is an n x n matrix. It is possible to show that each element 
of this matrix sum converges for all t as n -> oo. Thus the series (22) defines as its 
sum a new matrix, which we denote by exp (At); that is, 

°° \ n t n 

exp (At) = I + E^r. ( 23 > 

n =1 


analogous to the expansion (21) of the scalar function exp (at). 
By differentiating the series (23) term by term, we obtain 


d A A n t n ~ 1 

— [exp(A0] = Y - -— = A 


n =1 


(n -1 )! 


■E 

n =1 


AV 


ft! 


= A exp (At). 


Therefore, exp(At) satisfies the differential equation 

d 


dt 


exp (At) = A exp (At). 


(24) 


(25) 


Further, by setting t = 0 in Eq. (23) we find that exp(At) satisfies the initial condition 


exp (At) 



(26) 


The fundamental matrix $ satisfies the same initial value problem as exp(Ar), namely, 


= A$, <fr(0) = I. 


(27) 


Then, by the uniqueness part of Theorem 7.1.2 (extended to matrix differential equa¬ 
tions), we conclude that exp(At) and the fundamental matrix 4>(t) are the same. Thus 
we can write the solution of the initial value problem (19) in the form 

x = exp(At)x°, (28) 


which is analogous to the solution (18) of the initial value problem (17). 

In order to j ustify more conclusively the use of exp (At) for the sum of the series (22), 
we should demonstrate that this matrix function does indeed have the properties we 
associate with the exponential function. One way to do this is outlined in Problem 15. 


Diagonalizable Matrices. The basic reason why a system of linear (algebraic or differ¬ 
ential) equations presents some difficulty is that the equations are usually coupled. 
In other words, some or all of the equations involve more than one—typically all—of 
the unknown variables. Hence the equations in the system must be solved simultane¬ 
ously. In contrast, if each equation involves only a single variable, then each equation 
can be solved independently of all the others, which is a much easier task. This obser¬ 
vation suggests that one way to solve a system of equations might be by transforming 
it into an equivalent uncoupled system in which each equation contains only one 
unknown variable. This corresponds to transforming the coefficient matrix A into a 
diagonal matrix. 

Eigenvectors are useful in accomplishing such a transformation. Suppose that the 
n x n matrix A has a full set of n linearly independent eigenvectors. Recall that this 
will certainly be the case if the eigenvalues of A are all different, or if A is Hermitian. 
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Letting § (1) ,... ,§ (w) denote these eigenvectors and ki,...,k n the corresponding 
eigenvalues, form the matrix T whose columns are the eigenvectors—that is, 


W 


d ,0 J 


(29) 


Since the columns of T are linearly independent vectors, detT ^ 0; hence T is non¬ 
singular and T -1 exists. A straightforward calculation shows that the columns of the 
matrix AT are just the vectors A§ (1) ,..., A% (n \ Since A§ (/:) = k k ^ k \ it follows that 


where 


AT 


D 


AiSP 







Ai 

0 

••• 0 \ 

) = 

0 

A 

... 0 


\o 

0 

••• u 


TD, 


(30) 


(31) 


is a diagonal matrix whose diagonal elements are the eigenvalues of A. From Eq. 
it follows that 

T _1 AT = D. 


(30) 

(32) 


Thus, if the eigenvalues and eigenvectors of A are known, A can be transformed 
into a diagonal matrix by the process shown in Eq. (32). This process is known as a 
similarity transformation, and Eq. (32) is summed up in words by saying that A is 
similar to the diagonal matrix D. Alternatively, we may say that A is diagonalizable. 
Observe that a similarity transformation leaves the eigenvalues of A unchanged and 
transforms its eigenvectors into the coordinate vectors e (1) ,..., e (w) . 

If A is Hermitian, then the determination of T _1 is very simple. The eigenvectors 
§ (1) ,... ,§ (n) of A are known to be mutually orthogonal, so let us choose them so 
that they are also normalized by (§ w , § w ) = 1 for each i. Then it is easy to verify that 
T -1 = T*; in other words, the inverse of T is the same as its adjoint (the transpose of 
its complex conjugate). 

Finally, we note that if A has fewer than n linearly independent eigenvectors, then 
there is no matrix T such that T _1 AT = D. In this case, A is not similar to a diagonal 
matrix and is not diagonalizable. 


Consider the matrix 

EXAMPLE 


Find the similarity transformation matrix T and show that A can be diagonalized. 

In Example 2 of Section 7.5, we found that the eigenvalues and eigenvectors of A are 




r\ — 3, ? ( 


(34) 
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Thus the transformation matrix T and its inverse T 1 are 



Consequently, you can check that 



(35) 


(36) 


Now let us turn again to the system 

x' = Ax, 


(37) 


where A is a constant matrix. In Sections 7.5 and 7.6, we described how to solve 
such a system by starting from the assumption that x = %e rt . Now we provide another 
viewpoint, one based on diagonalizing the coefficient matrix A. 

According to the results stated just above, it is possible to diagonalize A whenever A 
has a full set of n linearly independent eigenvectors. Let § (1) ,..., § (n) be eigenvectors 
of A corresponding to the eigenvalues r \,..., r n and form the transformation matrix 
T whose columns are § (1) ,..., § (n) . Then, defining a new dependent variable y by the 
relation 

x = Ty, (38) 

we have from Eq. (37) that 

Ty = ATy 

Multiplying by T -1 , we then obtain 

y = (T -1 AT)y, 

or, using Eq. (32), 

y = Dy (41) 


(39) 

(40) 


Recall that D is the diagonal matrix with the eigenvalues r\,,r n of A along the 
diagonal. A fundamental matrix for the system (41) is the diagonal matrix (see 
Problem 16) 


(e nt 


Q (0 = exp (Dr) 


11 


0 


P r 2 t 


°\ 

0 


(42) 


V 0 0 • • • e r "'J 


A fundamental matrix for the system (37) is then found from Q by the transfor¬ 
mation (38) 

* = TQ; (43) 


that is, 


WV 1 ' • • • ^"V»7 


*(0 = 


(44) 
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EXAMPLE 

4 


PROBLEMS 


The columns of 'fr(t) are the same as the solutions in Eq. (27) of Section 7.5. Thus 
the diagonalization procedure does not offer any computational advantage over the 
method of Section 7.5, since in either case it is necessary to calculate the eigenvalues 
and eigenvectors of the coefficient matrix in the system of differential equations. 


Consider again the system of differential equations 

x' = Ax, (45) 

where A is given by Eq. (33). Using the transformation x = Ty, where T is given by Eq. (35), 
you can reduce the system (45) to the diagonal system 

y' = (Q _ J y = Dy. (46) 


Obtain a fundamental matrix for the system (46), and then transform it to obtain a fundamen¬ 
tal matrix for the original system (45). 

By multiplying D repeatedly with itself, we find that 


D 2 = 



(47) 


Therefore, it follows from Eq. (23) that exp (DO is a diagonal matrix with the entries e 3t and 
e~ f on the diagonal; that is, 


e 


D t _ 




(48) 


Finally, we obtain the required fundamental matrix ty(t) by multiplying T and exp (DO: 


*(0 = 




(49) 


Observe that this fundamental matrix is the same as the one found in Example 1. 


In each of Problems 1 through 10: 

(a) Find a fundamental matrix for the given system of equations. 

(b) Also find the fundamental matrix 4>(0 satisfying 4>(0) = I. 
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i 

1 



1 

-1 

4 ) 

9. x' = 

2 

1 

-i X 

O 

II 

3 

2 

-i 


(-8 

-5 

-3 J 


l 2 

1 

-i J 


11. Solve the initial value problem 



by using the fundamental matrix 4>(t) found in Problem 3. 

12. Solve the initial value problem 



by using the fundamental matrix 4>(t) found in Problem 6. 

13. Show that 4>(t) = O(0O _1 (t 0 ), where 0(0 and 0(0 are as defined in this section. 

14. The fundamental matrix 0(0 for the system (3) was found in Example 2. Show that 
0(0 0(0 = 0(t + s) by multiplying 0(0 and 0(0- 

15. Let 0(0 denote the fundamental matrix satisfying O' = AO, 0(0) = I. In the text we also 
denoted this matrix by exp (AO- In this problem we show that O does indeed have the 
principal algebraic properties associated with the exponential function. 

(a) Show that 0(00(0 = 0(t + 0; that is, show that exp (AO exp (AO = exp [A (t + 01- 
Hint: Show that if s is fixed and t is variable, then both 0(00(0 and 0(t + s) satisfy the 
initial value problem Z! = AZ, Z(0) = 0(0- 

(b) Show that O(0O(—0 = I; that is, exp (AO exp[A(—01 = I. Then show that 
$(-0 = $ -1 (0. 

(c) Show that <I> (f — s) = $(f)$ _1 (s). 

16. Show that if A is a diagonal matrix with diagonal elements ai,a 2 ,... ,a n , then exp(AO is 
also a diagonal matrix with diagonal elements exp(«iO, exp(a 2 0> • • •, exp(a n t). 

17. Consider an oscillator satisfying the initial value problem 

u" + co 2 u = 0, w(0) = uq, u'( 0) = vo. (i) 

(a) Let x\ = u,x 2 = u', and transform Eqs. (i) into the form 

x' = Ax, x(0) = x°. (ii) 

(b) By using the series (23), show that 


exp At = I cos cot + A 


sin cot 
co 


(hi) 


(c) Lind the solution of the initial value problem (ii). 

18. The method of successive approximations (see Section 2.8) can also be applied to systems 
of equations. Lor example, consider the initial value problem 


x' = Ax, x(0) = x°, 


(i) 


where A is a constant matrix and x° is a prescribed vector. 
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(a) Assuming that a solution x = 0(t) exists, show that it must satisfy the integral equation 

0(0 = x° + f A0(s) ds. (ii) 

Jo 

(b) Start with the initial approximation </> (0 \t) = x°. Substitute this expression for </>(s ) in 
the right side of Eq. (ii) and obtain a new approximation 0 (1) (O- Show that 


0 (1) (O = (I + At)x°. (hi) 

(c) Repeat this process and thereby obtain a sequence of approximations 0 (O) , 0 (1) , 

0 (2) ,..., 0 ( " ) ,_Use an inductive argument to show that 

0 W (O = (i + At + A 2 ^ + • • • + x°. (iv) 

(d) Let n ^ o o and show that the solution of the initial value problem (i) is 

0(0 = exp(A0x°. (v) 


7.8 Repeated Eigenvalues 


We conclude our consideration of the linear homogeneous system with constant 
coefficients 

x' = Ax (1) 

with a discussion of the case in which the matrix A has a repeated eigenvalue. Recall 
that in Section 7.3 we stated that a repeated eigenvalue with algebraic multiplicity 
m >2 may have a geometric multiplicity less than m. In other words, there may be 
fewer than m linearly independent eigenvectors associated with this eigenvalue. The 
following example illustrates this possibility. 


EXAMPLE 

1 


Find the eigenvalues and eigenvectors of the matrix 



The eigenvalues r and eigenvectors £ satisfy the equation (A — rl)£ = 0, or 



-1 

3- 




The eigenvalues are the roots of the equation 


det(A — rl) 


1-r 

1 


-1 
3 — r 


= r 2 - 4r + 4 = (r - 2) 2 = 0. 


( 2 ) 


(3) 


(4) 


Thus the two eigenvalues are r\ — 2 and r 2 = 2; that is, the eigenvalue 2 has algebraic multi¬ 
plicity 2. 
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To determine the eigenvectors, we must return to Eq. (3) and use for r the value 2. This gives 


-1 

1 





(5) 


Hence we obtain the single condition + § 2 = 0, which determines §2 in terms of fi, or vice 
versa. Thus the eigenvector corresponding to the eigenvalue r = 2 is 


s (1) = 



( 6 ) 


or any nonzero multiple of this vector. Observe that there is only one linearly independent 
eigenvector associated with the double eigenvalue. 


Returning to the system (1), suppose that r = p is an ra-fold root of the charac¬ 
teristic equation 

det(A - rl) = 0. (7) 

Then p is an eigenvalue of algebraic multiplicity m of the matrix A. In this event, 
there are two possibilities: either there are m linearly independent eigenvectors 
corresponding to the eigenvalue p, or else there are fewer than m such eigenvectors. 

In the first case, let £ (1) ,..., § (m) be m linearly independent eigenvectors associ¬ 
ated with the eigenvalue p of algebraic multiplicity m. Then there are m linearly 
independent solutions x (1) (7) = § (1) e pt ,..., x (m) (7) = § (m) e^ of Eq. (1). Thus in this 
case it makes no difference that the eigenvalue r = p is repeated; there is still a fun¬ 
damental set of solutions of Eq. (1) of the form %e n . This case always occurs if the 
coefficient matrix A is Hermitian (or real and symmetric). 

However, if the coefficient matrix is not Hermitian, then there may be fewer than m 
independent eigenvectors corresponding to an eigenvalue p of algebraic multiplicity 
m, and if so, there will be fewer than m solutions of Eq. (1) of the form l-e pt associ¬ 
ated with this eigenvalue. Therefore, to construct the general solution of Eq. (1), it is 
necessary to find other solutions of a different form. Recall that a similar situation 
occurred in Section 3.4 for the linear equation ay" + by' + cy = 0 when the charac¬ 
teristic equation has a double root r. In that case we found one exponential solution 
yi(t) = e rt , but a second independent solution had the form y 2 (t) = te n . With that 
result in mind, consider the following example. 


EXAMPLE 

2 


Find a fundamental set of solutions of 



( 8 ) 


and draw a phase portrait for this system. 

A direction field for the system (8) is shown in Figure 7.8.1. From this figure it appears that 
all nonzero solutions depart from the origin. 

To solve the system, observe that the coefficient matrix A is the same as the matrix in Exam¬ 
ple 1. Thus we know that r = 2 is a double eigenvalue and that it has only a single corresponding 
eigenvector, which we may take as = (1,-1). Thus one solution of the system (8) is 


X N(0 = 



( 9 ) 


but there is no second solution of the form x = ^e rt . 
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FIGURE 7.8.1 A direction field for the system (8). 


Based on the procedure used for second order linear equations in Section 3.4, it may be 
natural to attempt to find a second independent solution of the system (8) of the form 


x = i;te 2t , 


( 10 ) 


where ? is a constant vector to be determined. Substituting for x in Eq. (8), we obtain 


2%te Zt + %e 2t — A%te Zt = 0. (11) 

For Eq. (11) to be satisfied for all t , it is necessary for the coefficients of te 2t and e 2t both to be 
zero. From the term in e 2t we find that 


« = 0 . ( 12 ) 

Hence there is no nonzero solution of the system (8) of the form (10). 

Since Eq. (11) contains terms in both te 2t and e 2t , it appears that in addition to %te 2t , the 
second solution must contain a term of the form rje 2t ; in other words, we need to assume that 

x = %te 2t + ) ]e 2t , (13) 

where ? and rj are constant vectors to be determined. Upon substituting this expression for x 
in Eq. (8), we obtain 

2 %te 2t + ($ + 2 ri)e 2t = A {&e Zt + rje 2t ). (14) 

Equating coefficients of te 2t and e 2t on each side of Eq. (14) gives the two conditions 

(A - 21)? = 0 (15) 


and 


(A-21)* = $ (16) 

for the determination of ? and rj. Equation (15) is satisfied if ? is an eigenvector of A 
corresponding to the eigenvalue r = 2, such as $ r = (1, — 1). Since det(A — 21) is zero, 
Eq. (16) is solvable only if the right side ? satisfies a certain condition. Fortunately, ? and 
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its multiples are exactly the vectors that allow Eq. (16) to be solved. The augmented matrix for 
Eq. (16) is 



The second row of this matrix is proportional to the first, so the system is solvable. We have 


~m - m = l, 


so if rj\ = k , where k is arbitrary, then r \ 2 — ~k — 1. If we write 


Yj = 




then by substituting for £ and rj in Eq. (13), we obtain 


x = 


te 2t + 




(17) 


(18) 


The last term in Eq. (18) is merely a multiple of the first solution x (1) (t) and may be ignored, 
but the first two terms constitute a new solution: 


x®(f) = 



(19) 


An elementary calculation shows that W[x (1) , x (2) ](t) = — e 4t ^ 0, and therefore x (1) and x (2) 
form a fundamental set of solutions of the system (8). The general solution is 


X = CiX (1) (0 + c 2 x (2) (0 



( 20 ) 


The main features of a phase portrait for the solution (20) follow from the presence of the 
exponential factor e 2t in every term. Therefore x -> 0 as £ ^ —oo and, unless both c\ and c 2 are 
zero, x becomes unbounded as t oo. If c\ and c 2 are not both zero, then along any trajectory 
we have 


r x 2 (t) C\ c 2 t c 2 

lim -= lim -= —1. 

t-+-oo X\(t) t > oo C\ + c 2 t 


Therefore, as t — oo, every trajectory approaches the origin tangent to the line x 2 = —x\ 
determined by the eigenvector; this behavior is clearly evident in Figure 7.8.2a. Further, as 
t -> oo, the slope of each trajectory also approaches —1. However, it is possible to show that 
trajectories do not approach asymptotes as t oo. Several trajectories of the system (8) are 
shown in Figure 7.8.2a, and some typical plots of x\ versus t are shown in Figure 7.8.26. The 
pattern of trajectories in this figure is typical of 2 x 2 systems x' = Ax with equal eigenvalues 
and only one independent eigenvector. The origin is called an improper node in this case. If 
the eigenvalues are negative, then the trajectories are similar but are traversed in the inward 
direction. An improper node is asymptotically stable or unstable, depending on whether the 
eigenvalues are negative or positive. 
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FIGURE 7.8.2 ( a ) Phase portrait of the system (8); the origin is an 

improper node. ( b ) Plots of x\ versus t for the system (8). 


One difference between a system of two first order equations and a single second 
order equation is evident from the preceding example. For a second order linear 
equation with a repeated root r\ of the characteristic equation, a term ce rit in the sec¬ 
ond solution is not required since it is a multiple of the first solution. On the other 
hand, for a system of two first order equations, the term rje nt of Eq. (13) with r\ — 2 
is not, in general, a multiple of the first solution %e nt , so the term rje nt must be 
retained. 

Example 2 is entirely typical of the general case when there is a double eigenvalue 
and a single associated eigenvector. Consider again the system (1), and suppose that 
r = p is a double eigenvalue of A, but that there is only one corresponding eigenvector 
§. Then one solution [similar to Eq. (9)] is 

x (1) (0 = %ef*, (21) 

where § satisfies 

(A - pl)$ = 0. (22) 

By proceeding as in Example 2, we find that a second solution [similar to Eq. (19)] is 

x (2) (t) = %te pt + ije pt , (23) 

where § satisfies Eq. (22) and rj is determined from 

(A - p\)rj = $. (24) 


Even though det(A — pi) = 0, it can be shown that it is always possible to solve 
Eq. (24) for rj. Note that if we multiply Eq. (24) by A — pi and use Eq. (22), then we 
obtain 


(A - plfr] = 0. 


The vector rj is called a generalized eigenvector of the matrix A corresponding to the 
eigenvalue p. 


Fundamental Matrices. As explained in Section 7.7, fundamental matrices are formed 
by arranging linearly independent solutions in columns. Thus, for example, a 
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fundamental matrix for the system (8) can be formed from the solutions x (1) ( t ) and 
x (2) (t) from Eqs. (9) and (19), respectively: 


*(0 = 





(25) 


The particular fundamental matrix 4> that satisfies <I>(0) = I can also be readily found 
from the relation &(t) = ^(0^ _1 (0). For Eq. (8) we have 


*( 0 ) 




¥ _ 1 ( 0 ) 




(26) 


and then 


$(0 = ^( 0 ^ 




(27) 


The latter matrix is also the exponential matrix exp (At). 


Jordan Forms. An matrix A can be diagonalized as discussed in Section 7.7 only if 
it has a full complement of n linearly independent eigenvectors. If there is a shortage 
of eigenvectors (because of repeated eigenvalues), then A can always be transformed 
into a nearly diagonal matrix called its Jordan 6 form, which has the eigenvalues of 
A on the main diagonal, ones in certain positions on the diagonal above the main 
diagonal, and zeros elsewhere. 

Consider again the matrix A given by Eq. (2). To transform A into its Jordan form, 
we construct the transformation matrix T with the single eigenvector § from Eq. (6) 
in its first column and the generalized eigenvector rj from Eq. (17) with k = 0 in the 
second column. Then T and its inverse are given by 



As you can verify, it follows that 

T "‘ AT =(o 2) = ^ < 29 > 

The matrix J in Eq. (29) is the Jordan form of A. It is typical of all Jordan forms in that 
it has a 1 above the main diagonal in the column corresponding to the eigenvector 
that is lacking (and is replaced in T by the generalized eigenvector). 

If we start again from Eq. (1) 

x ; = Ax, 


6 Marie Ennemond Camille Jordan (1838-1922) was professor at the Ecole Poly technique and the College 
de France. He is known for his important contributions to analysis and to topology (the Jordan curve 
theorem) and especially for his foundational work in group theory. The Jordan form of a matrix appeared 
in his influential book Traite des substitutions et des equations algebriques, published in 1870. 
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the transformation x = Ty, where T is given by Eq. (28), produces the system 

y' = Jy, (30) 

where J is given by Eq. (29). In scalar form the system (30) is 

y[=2yi+y 2 , y'i = ^y 2 - (31) 

These equations can be solved readily in reverse order—that is, by starting with the 
equation for y 2 . In this way we obtain 

y 2 = c\e 2t , y\ = c\te 2t + c 2 e 2t . (32) 

Thus two independent solutions of the system (30) are 

y (1) w = (q) e 2t , y a> (t) = (^) e 2r , (33) 

and the corresponding fundamental matrix is 



Since ^(0) = I, we can also identify the matrix in Eq. (34) as exp(Jt). The same result 
can be reached by calculating powers of J and substituting them into the exponential 
series (see Problems 20 through 22). To obtain a fundamental matrix for the original 
system, we now form the product 


^(0 = T exp(Jt) = 



te 2t 

—e 2t — te 2t 


(35) 


which is the same as the fundamental matrix given in Eq. (25). 

We will not discuss wxw systems x' = Ax in more detail here. For large n it is 
possible that there may be eigenvalues of high algebraic multiplicity m, perhaps with 
much lower geometric multiplicity q , thus giving rise tom — q generalized eigenvec¬ 
tors. For n > 4 there may also be repeated complex eigenvalues. A full discussion 7 
of the Jordan form of a general n x n matrix requires a greater background in linear 
algebra than we assume for most readers of this book. Problems 18 through 22 ask 
you to explore the use of Jordan forms for systems of three equations. 

The amount of arithmetic required in the analysis of a general n x n system may 
be prohibitive to do by hand even if n is no greater than 3 or 4. Consequently, suitable 
computer software should be used routinely in most cases. This does not overcome 
all difficulties by any means, but it does make many problems much more tractable. 
Finally, for a set of equations arising from modeling a physical system, it is likely 
that some of the elements in the coefficient matrix A result from measurements of 
some physical quantity. The inevitable uncertainties in such measurements lead to 
uncertainties in the values of the eigenvalues of A. For example, in such a case it 
may not be clear whether two eigenvalues are actually equal or are merely close 
together. 


7 For example, see the books listed in the References at the end of this chapter. 
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PROBLEMS In each of Problems 1 through 4: 

(a) Draw a direction field and sketch a few trajectories. 

(b) Describe how the solutions behave as t -> oo. 

(c) Find the general solution of the system of equations. 


41 

4fi 



41 

41 




x 


x 


In each of Problems 5 and 6, find the general solution of the given system of equations. 



/i 

1 

1\ 


(0 

1 

i\ 


5. x' = 

2 

1 

-1 

x 6. x' = 

1 

0 

i 

X 


1° 

-1 

V 


l 1 

1 

°J 



In each of Problems 7 through 10: 

(a) Find the solution of the given initial value problem. 

(b) Draw the trajectory of the solution in the xix 2 -plane, and also draw the graph of x\ 
versus t. 


41 

41 

41 

41 




In each of Problems 11 and 12: 

(a) Find the solution of the given initial value problem. 

(b) Draw the corresponding trajectory in xix 2 x 3 -space, and also draw the graph of x\ versus t. 



1 

0 

°\ 



< -1\ 

41 ii. = 

-4 

1 

0 

x, 

x(0) = 

2 


3 

6 

y 



v -3 0y l 


(-1 

1 

i> 



2 "i 

41 12. x' = 

1 

5 

2 

i 

x, 

x(0) = 

3 


1 

1 

5 

2) 



v-v 


In each of Problems 13 and 14, solve the given system of equations by the method of Problem 
19 of Section 7.5. Assume that t > 0. 
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15. Show that all solutions of the system 


x' = 


X 


approach zero as t -> oo if and only if a + d < 0 and ad — be > 0. Compare this result 
with that of Problem 37 in Section 3.4. 

16. Consider again the electric circuit in Problem 26 of Section 7.6. This circuit is described 
by the system of differential equations 


d 

dt 



( 


0 


1 

\~c 



(a) Show that the eigenvalues are real and equal if L = 4 R 2 C. 

(b) Suppose that i? = H2, C = 1 F, and L = 4 H. Suppose also that 7(0) = 1 A and 
V(0) = 2 V. Find I(t) and V(t). 


17. Consider again the system 



(i) 


that we discussed in Example 2. We found there that A has a double eigenvalue n = r 2 = 2 
with a single independent eigenvector £ (1) = (1, — 1) T , or any nonzero multiple thereof. 
Thus one solution of the system (i) is x (1) (t) = £ ( l) e 2t and a second independent solution 
has the form 

x (2) (t) = %te 2t + rje 2t , 


where £ and rj satisfy 

(A-2I){ = 0, (A -21)* = $. (ii) 

In the text we solved the first equation for $ and then the second equation for rj. Here we 
ask you to proceed in the reverse order. 

(a) Show that rj satisfies (A - 21 ) 2 rj = 0. 

(b) Show that (A — 2I) 2 = 0. Thus the generalized eigenvector rj can be chosen arbitrarily, 
except that it must be independent of £ (1) . 

(c) Let rj = (0, — l) r . Then determine $ from the second of Eqs. (ii) and observe that 
$ = (1, — l) r = £ (1) . This choice of rj reproduces the solution found in Example 2. 

(d) Let rj = (1,0) r and determine the corresponding eigenvector £. 

(e) Let rj = (ki,k 2 ) T , where k\ and k 2 are arbitrary numbers. Then determine $. How is 
it related to the eigenvector £ (1) ? 

Eigenvalues of Multiplicity 3. If the matrix A has an eigenvalue of algebraic multiplicity 3, 
then there may be either one, two, or three corresponding linearly independent eigenvectors. 
The general solution of the system x' = Ax is different, depending on the number of eigenvec¬ 
tors associated with the triple eigenvalue. As noted in the text, there is no difficulty if there 
are three eigenvectors, since then there are three independent solutions of the form x = %e rt . 
The following two problems illustrate the solution procedure for a triple eigenvalue with one 
or two eigenvectors, respectively. 
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18. Consider the system 


x' = Ax = 


/ 1 

2 

v- 3 


i i\ 

i -i 


V 


(i) 


(a) Show that r = 2 is an eigenvalue of algebraic multiplicity 3 of the coefficient matrix 
A and that there is only one corresponding eigenvector, namely, 


s (1) = 


o\ 

1 

v-v 


(b) Using the information in part (a), write down one solution x (1) (t) of the system (i). 
There is no other solution of the purely exponential form x = %e rt . 

(c) To find a second solution, assume that x = %te 2t + rje 2t . Show that £ and rj satisfy the 
equations 

(A-2I){ = 0, (A -21)* = $. 

Since $ has already been found in part (a), solve the second equation for rj. Neglect the 
multiple of £ (1) that appears in rj , since it leads only to a multiple of the first solution x (1) . 
Then write down a second solution x (2) (t) of the system (i). 

(d) To find a third solution, assume that x = %(t 2 /2)e 2t + rjte 2t + £e 2t . Show that £, rj , and £ 
satisfy the equations 

(A — 21)$ = 0, (A-21 )j/ = $, (A — 21)£ = rj. 

The first two equations are the same as in part (c), so solve the third equation for £, again 
neglecting the multiple of £ (1) that appears. Then write down a third solution x (3) (t) of the 
system (i). 

(e) Write down a fundamental matrix ty(t) for the system (i). 

(f) Form a matrix T with the eigenvector £ (1) in the first column and the generalized 
eigenvectors rj and £ in the second and third columns. Then find T -1 and form the product 
J = T -1 AT. The matrix J is the Jordan form of A. 

19. Consider the system 


x = Ax = 


/ 



(i) 


(a) Show that r = 1 is a triple eigenvalue of the coefficient matrix A and that there are 
only two linearly independent eigenvectors, which we may take as 


(ii) 



(i\ 


0 \ 

£ (1) = 

0 

£ (2) = 

2 


Write down two linearly independent solutions x (1) (t) and x (2) (t) of Eq. (i). 

(b) To find a third solution, assume that x = %te l + rje then show that £ and rj must satisfy 


(A - I)$ = 0, 

(A-D * = $• 


(iii) 

(iv) 
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(c) Equation (iii) is satisfied if £ is an eigenvector, so one way to proceed is to choose 
£ to be a suitable linear combination of £ (1) and £ (2) so that Eq. (iv) is solvable, and then 
to solve that equation for rj. However, let us proceed in a different way and follow the 
pattern of Problem 17. First, show that rj satisfies 

(A - I ) 2 ri = 0. 


Further, show that (A — I) 2 = 0. Thus rj can be chosen arbitrarily, except that it must be 
independent of £ (1) and £ (2) . 

(d) A convenient choice for rj is rj = (0,0, 1) T . Find the corresponding £ from Eq. (iv). 
Verify that £ is an eigenvector. 

(e) Write down a fundamental matrix ty(t) for the system (i). 

(f) Form a matrix T with the eigenvector £ (1) in the first column and with the eigenvector 
£ from part (d) and the generalized eigenvector rj in the other two columns. Find T -1 and 
form the product J = T -1 AT. The matrix J is the Jordan form of A. 


20. Fet J = 


^, where X is an arbitrary real number. 


(a) Find J 2 ,J 3 , and J 4 . 

(b) Use an inductive argument to show that J” = 

(c) D etermine exp (J t ). 

(d) Use exp(J0 to solve the initial value problem x' = Jx, x(0) = x°. 
21. Fet 



J = 


(x 0 
0 1 
^0 0 


0 ^ 

1 

V 


where X is an arbitrary real number. 

(a) Find J 2 ,J 3 , and J 4 . 

(b) Use an inductive argument to show that 



(x n 

0 

0 \ 

r = 

0 

x n 

nA" _1 



0 

/ 


(c) Determine exp (JO- 

(d) Observe that if you choose X = 1, then the matrix J in this problem is the same as 
the matrix J in Problem 19(f). Using the matrix T from Problem 19(f), form the product 
T exp(Jt) with X = 1. Is the resulting matrix the same as the fundamental matrix ^(0 in 
Problem 19(e)? If not, explain the discrepancy. 


22. Fet 



where X is an arbitrary real number, 
(a) Find J 2 ,J 3 , and J 4 . 
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(b) Use an inductive argument to show that 


J 


n 


/x n 

0 

\0 


nX n 1 
X n 

0 


\n(n - l)/2]A, n_2 \ 
nX n ~ l 
X- ) 


(c) Determine exp(Jf). 

(d) Note that if you choose X — 2, then the matrix J in this problem is the same as the 
matrix J in Problem 18(f). Using the matrix T from Problem 18(f), form the product 
T exp(Jf) with X = 2. The resulting matrix is the same as the fundamental matrix ty(t) in 
Problem 18(e). 


7.9 Nonhomogeneous Linear Systems 

In this section we turn to the nonhomogeneous system 

x' = P(f)X + g (t), (1) 

where the n x n matrix P (t) and n x 1 vector g (t) are continuous for a < t < By 
the same argument as in Section 3.5 (see also Problem 16 in this section), the general 
solution of Eq. (1) can be expressed as 

X = Cix (1) (0 H- b C n x (n \t ) + v(0, (2) 

where cix (1) (7) + • • • + c n x^ n \t) is the general solution of the homogeneous system 
x ; = P (t)x, and v(7) is a particular solution of the nonhomogeneous system (1). We 
will briefly describe several methods for determining y(t). 

Diagonalization. We begin with systems of the form 

x' = Ax + g(0, (3) 

where A is an n x n diagonalizable constant matrix. By diagonalizing the coefficient 
matrix A, as indicated in Section 7.7, we can transform Eq. (3) into a system of 
equations that is readily solvable. 

Let T be the matrix whose columns are the eigenvectors § (1) ,...,§of A, and 
define a new dependent variable y by 

x=Ty. (4) 

Then, substituting for x in Eq. (3), we obtain 

Ty ; = ATy + g (t). 

When we multiply by T -1 , it follows that 

y' = (T _1 AT)y + T"^) = Dy + h(t), (5) 

where h(f) =T _1 g(r) and where D is the diagonal matrix whose diagonal entries 
are the eigenvalues ri,..., r n of A, arranged in the same order as the corresponding 
eigenvectors § (1) ,..., § (n) that appear as columns of T. Equation (5) is a system of 
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n uncoupled equations for ... ,y n (t); as a consequence, the equations can be 
solved separately. In scalar form, Eq. (5) has the form 

= rjyjit) + hj(t), j = 1,..., n, (6) 

where hj(t) is a certain linear combination of gi(t),... ,g n if). Equation (6) is a first 
order linear equation and can be solved by the methods of Section 2.1. In fact, we 
have t 

yj(t) = e rjt f e~ rjS hj{s) ds + Cje rjt , j = 1,..., n, (7) 

Jto 

where the cy are arbitrary constants. Finally, the solution x of Eq. (3) is obtained from 
Eq. (4). When multiplied by the transformation matrix T, the second term on the 
right side of Eq. (7) produces the general solution of the homogeneous equation 
x' = Ax, while the first term on the right side of Eq. (7) yields a particular solution of 
the nonhomogeneous system (3). 


Find the general solution of the system 




= Ax + g(f). 


( 8 ) 


Proceeding as in Section 7.5, we find that the eigenvalues of the coefficient matrix are 
n = —3 and r 2 = — 1 and that the corresponding eigenvectors are 



Thus the general solution of the homogeneous system is 



Before writing down the matrix T of eigenvectors, we recall that eventually we must find T -1 . 
The coefficient matrix A is real and symmetric, so we can use the result stated just above 
Example 3 in Section 7.7: T -1 is simply the adjoint or (since T is real) the transpose of T, 
provided that the eigenvectors of A are normalized so that (£, £) = 1. Hence, upon normalizing 
£ (1) and £ (2) , we have 


T 


1 

V5 



T"i 




( 11 ) 


Letting x = Ty and substituting for x in Eq. (8), we obtain the following system of equations 
for the new dependent variable y: 


y' = Dy + T- 1 g(0 


/— 3 0\ 1 / 2e~‘ — 3 A 

\ 0 -l/ y+ 7! \2e-' + 3 1 )' 


( 12 ) 


Thus 


y[ + 3yi = \fle 1 - 



y' 2 +y 2 = V2e 1 + 



( 13 ) 
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Each of Eqs. (13) is a first order linear equation and so can be solved by the methods of Section 
2.1. In this way we obtain 



y 2 = V2te 1 + 


3 

V5 


(t — 1) + c 2 e 1 . 


Finally, we write the solution in terms of the original variables: 


(14) 


_ i ( yi+y 2 

x = Ty = — 

\/2 \—yi + y 2 

^ ( C\ / \J2)e 3r + |^(C 2 / y/2) + ^ j £ 1 -\-1 — | + tc 1 ^ 
(ci/\/2)c 3r + ^(^ 2 /\/2) — \ j e ? + 2t — | + te 1 ^ 



where k\ = C\/\/2 and k 2 = c 2 /\/2. The first two terms on the right side of Eq. (15) form the 
general solution of the homogeneous system corresponding to Eq. (8). The remaining terms 
are a particular solution of the nonhomogeneous system. 


If the coefficient matrix A in Eq. (3) is not diagonalizable (because of repeated 
eigenvalues and a shortage of eigenvectors), it can nevertheless be reduced to 
a Jordan form J by a suitable transformation matrix T involving both eigen¬ 
vectors and generalized eigenvectors. In this case the differential equations for 
yi,...,y n are not totally uncoupled since some rows of J have two nonzero ele¬ 
ments: an eigenvalue in the diagonal position and a 1 in the adjacent position to 
the right. However, the equations for yi, ... ,y n can still be solved consecutively, 
starting with y n . Then the solution of the original system (3) can be found by the 
relation x = Ty 

Undetermined Coefficients. A second way to find a particular solution of the nonho¬ 
mogeneous system (1) is the method of undetermined coefficients that we first 
discussed in Section 3.5. To use this method, we assume the form of the solution 
with some or all of the coefficients unspecified, and then seek to determine these 
coefficients so as to satisfy the differential equation. As a practical matter, this 
method is applicable only if the coefficient matrix P is a constant matrix, and if 
the components of g are polynomial, exponential, or sinusoidal functions, or sums 
or products of these. In these cases the correct form of the solution can be pre¬ 
dicted in a simple and systematic manner. The procedure for choosing the form of 
the solution is substantially the same as that given in Section 3.5 for linear second 
order equations. The main difference is illustrated by the case of a nonhomogeneous 
term of the form ue u , where A is a simple root of the characteristic equation. In 
this situation, rather than assuming a solution of the form a te xt , it is necessary to 
use &te xt + be u , where a and b are determined by substituting into the differential 
equation. 
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Use the method of undetermined coefficients to find a particular solution of 

x '=(“? -2) X+ ( 2 3 f )= Ax + 8 (f) - (16) 

This is the same system of equations as in Example 1. To use the method of undetermined 
coefficients, we write g(t) in the form 


g (0 = 



(17) 


Observe that r — —1 is an eigenvalue of the coefficient matrix, and therefore we must include 
both 2 ite~ f and be~ l in the assumed solution. Thus we assume that 


x = \{t) = Site 1 + be 1 + ct + d, (18) 

where a, b, c, and d are vectors to be determined. By substituting Eq. (18) into Eq. (16) and 
collecting terms, we obtain the following algebraic equations for a, b, c, and d: 


Aa = —a, 

Ab = a — b — 



Ad = c. 



(19) 


From the first of Eqs. (19), we see that a is an eigenvector of A corresponding to the eigenvalue 
r = —1. Thus a r = (a, a), where a is any nonzero constant. Then we find that the second of 
Eqs. (19) can be solved only if a = 1 and that in this case, 



( 20 ) 


for any constant k. The simplest choice is k = 0, from which b r = (0, —1). Then the third and 
fourth of Eqs. (19) yield c T = (1,2) and d r = (— ~, -~), respectively. Finally, from Eq. (18) we 
obtain the particular solution 


▼(0 = 



( 21 ) 


The particular solution (21) is not identical to the one contained in Eq. (15) of Example 1 
because the term in e _ Us different. However, if we choose A: = \ inEq. (20), then b r = (-, — \) 
and the two particular solutions agree. 


Variation of Parameters. Now let us turn to more general problems in which the 
coefficient matrix is not constant or not diagonalizable. Let 

x' = P(0x + g(0, (22) 

where P(0 and g (t) are continuous on a < t < /3. Assume that a fundamental matrix 
^f(t) for the corresponding homogeneous system 

x' = P (Ox 


(23) 
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has been found. We use the method of variation of parameters to construct a partic¬ 
ular solution, and hence the general solution, of the nonhomogeneous system (22). 

Since the general solution of the homogeneous system (23) is ^(t)c, it is natural to 
proceed as in Section 3.6 and to seek a solution of the nonhomogeneous system (22) 
by replacing the constant vector c by a vector function u(t)- Thus we assume that 

x = (24) 

where u (t) is a vector to be found. Upon differentiating x as given by Eq. (24) and 
requiring that Eq. (22) be satisfied, we obtain 

+ ¥(0o'(f) = P + g(t). (25) 

Since ^(t) is a fundamental matrix, ty\t) = P (t)ty(t); hence Eq. (25) reduces to 

= g (t). (26) 

Recall that H*(t) is nonsingular on any interval where P is continuous. Hence ^ _1 (t) 
exists, and therefore 

U'(0 = * _1 (0g(0- (27) 

Thus for u(t) we can select any vector from the class of vectors that satisfy Eq. (27). 
These vectors are determined only up to an arbitrary additive constant vector; 
therefore, we denote u (t) by 

u(t) = J V~\t)g(t)dt + c, (28) 

where the constant vector c is arbitrary. If the integrals in Eq. (28) can be evaluated, 
then the general solution of the system (22) is found by substituting for u (t) from 
Eq. (28) in Eq. (24). However, even if the integrals cannot be evaluated, we can still 
write the general solution of Eq. (22) in the form 

X = *P(f)c + ty(t) [ * _1 (s)gO) ds, (29) 

Jtl 

where t\ is any point in the interval (a, fi). The first term on the right side of Eq. (29) is 
the general solution of the corresponding homogeneous system (23), and the second 
term is a particular solution of Eq. (22). 

Now let us consider the initial value problem consisting of the differential equation 
(22) and the initial condition 

x(f 0 ) = X°. (30) 


We can find the solution of this problem most conveniently if we choose the lower 
limit of integration in Eq. (29) to be the initial point to - Then the general solution of 
the differential equation is 


x = ¥(f)c + ¥(0 


f 

J to 


^~ 1 (s)g(s)ds. 


(31) 


For t = to the integral in Eq. (31) is zero, so the initial condition (30) is also satisfied 
if we choose 


c = vp- 1 (?o)x°. 


( 32 ) 
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Therefore, 

X = + *(t) [ y-\s)g(s) ds (33) 

Jto 

is the solution of the given initial value problem. Again, although it is helpful to use 
to write the solutions (29) and (33), it is usually better in particular cases to solve 
the necessary equations by row reduction than to calculate and substitute into 
Eqs. (29) and (33). 

The solution (33) takes a slightly simpler form if we use the fundamental matrix 
4>(0 satisfying 4>(fe) = I. In this case we have 

x = 4>(t)x° + 4>(t) f 4> _1 (s)g(s) ds. (34) 

Jto 

Equation (34) can be simplified further if the coefficient matrix P (t) is a constant 
matrix (see Problem 17). 


Use the method of variation of parameters to find the general solution of the system 

EXAMPLE 

3 x '=(“5 j) x+ ( 2 3r)= Ax + S«- < 35 ) 

This is the same system of equations as in Examples 1 and 2. 

The general solution of the corresponding homogeneous system was given in Eq. (10). Thus 



is a fundamental matrix. Then the solution x of Eq. (35) is given by x = where u(t) 

satisfies <P(f)u'(0 = g (t), or 



Solving Eq. (37) by row reduction, we obtain 

u\ = e 2t — | te 3t , 
u' 2 = 1 + | te*. 

Hence 

u x (t) = \e 2t - \te 3t + \e 3t + c u 
u 2 (t) = t + | te x — \e l + C 2 , 

and 

x = W(t)u(t) 



which is the same as the solution obtained in Example 1 [Eq. (15)] and is equivalent to the 
solution obtained in Example 2 [Eq. (21)]. 
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Laplace Transforms. We used the Laplace transform in Chapter 6 to solve linear equa¬ 
tions of arbitrary order. It can also be used in very much the same way to solve 
systems of equations. Since the transform is an integral, the transform of a vector is 
computed component by component. Thus £{x(t)} is the vector whose components 
are the transforms of the respective components of x(t), and similarly for £{x'(t)}. 
We will denote £{x(t)} by X(s). Then, by an extension of Theorem 6.2.1 to vectors, 
we also have 

£{x'(t)} = sX(s) - x(0). (39) 


Use the method of Laplace transforms to solve the system 

= Ax + g(f). 


-2 1 
1 -2 


x + 


2e~‘ 
31 


This is the same system of equations as in Examples 1 through 3. 

We take the Laplace transform of each term in Eq. (40), obtaining 

sX(s) - x(0) = AX 0) + GO), 

where GO) is the transform of g(0- The transform GO) is given by 


GO) = 


2/0 + 1 ) 

3/s 2 


(40) 


(41) 


(42) 


To proceed further we need to choose the initial vector x(0). For simplicity let us choose 
x(0) = 0. Then Eq. (41) becomes 


01 - A)X0) = GO), 


(43) 


where, as usual, I is the identity matrix. Consequently, X0) is given by 

XO) = 01 -A) -1 GO). (44) 

The matrix 01 — A) -1 is called the transfer matrix because multiplying it by the transform of 
the input vector g(0 yields the transform of the output vector x(t). In this example we have 


sl-A = 





(45) 


and by a straightforward calculation, we obtain 


(si-A)" 1 


1 /s + 2 1 \ 

0 +1)0 + 3) y l s + 2 J 


(46) 


Then, substituting from Eqs. (42) and (46) in Eq. (44) and carrying out the indicated multi¬ 
plication, we find that 


X0) = 


/ 2Q + 2) 

0 + 1) 2 0 + 3) + 
2 

v(s + l) 2 (s + 3) + 


\ 


s 2 (s + l)(s + 3) 

30 + 2 ) 

s 2 0 + 1)0 + 3)/ 


(47) 


Finally, we need to obtain the solution x(t) from its transform X0). This can be done by 
expanding the expressions in Eq. (47) in partial fractions and using Table 6.2.1, or (more 
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efficiently) by using appropriate computer software. In any case, after some simplification the 
result is 



Equation (48) gives the particular solution of the system (40) that satisfies the initial condition 
x(0) = 0. As a result, it differs slightly from the particular solutions obtained in the preceding 
three examples. To obtain the general solution of Eq. (40), you must add to the expression in 
Eq. (48) the general solution (10) of the homogeneous system corresponding to Eq. (40). 


Each of the methods for solving nonhomogeneous equations has some advantages 
and disadvantages. The method of undetermined coefficients requires no integra¬ 
tion, but it is limited in scope and may entail the solution of several sets of algebraic 
equations. The method of diagonalization requires finding the inverse of the trans¬ 
formation matrix and the solution of a set of uncoupled first order linear equations, 
followed by a matrix multiplication. Its main advantage is that for Hermitian coeffi¬ 
cient matrices, the inverse of the transformation matrix can be written down without 
calculation—a feature that is more important for large systems. The method of 
Laplace transforms involves a matrix inversion to find the transfer matrix, followed 
by a multiplication, and finally by the determination of the inverse transform of each 
term in the resulting expression. It is particularly useful in problems with forcing 
functions that involve discontinuous or impulsive terms. Variation of parameters is 
the most general method. On the other hand, it involves the solution of a set of lin¬ 
ear algebraic equations with variable coefficients, followed by an integration and a 
matrix multiplication, so it may also be the most complicated from a computational 
viewpoint. For many small systems with constant coefficients, such as the one in the 
examples in this section, all of these methods work well, and there may be little reason 
to select one over another. 


PROBLEMS 


In each of Problems 1 through 12 find the general solution of the given system of equations. 




2. x 

4. x 7 






t > 0 



t > 0 

8. x 7 

10. x 7 



e 1 
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11. x 7 = 


12. x' = 


2 -5 
1 -2 

2 -5 
1 -2 


x + 


x + 


0 

cos t 

CSC t 

sec t 


0 < t < 71 


71 

— < t < 7T 
2 


13. The electric circuit shown in Figure 7.9.1 is described by the system of differential equations 


dx 

dt 


1 

2 

2 - 


x + 


I(t), 


(i) 


where x\ is the current through the inductor, x 2 is the voltage drop across the capacitor, 
and I{t) is the current supplied by the external source. 

(a) Determine a fundamental matrix ty(t) for the homogeneous system corresponding to 
Eq. (i). Refer to Problem 25 of Section 7.6. 

(b) If 7(0 = e~ t/2 , determine the solution of the system (i) that also satisfies the initial 
conditions x(0) = 0. 


L = 8 henrys 



FIGURE 7.9.1 The circuit in Problem 13. 


In each of Problems 14 and 15, verify that the given vector is the general solution of the 
corresponding homogeneous system, and then solve the nonhomogeneous system. Assume 
that t > 0. 



16. Let x = 0(0 be the general solution of x ; = P(0x + g(0, and let x = v(0 be some 
particular solution of the same system. By considering the difference 0(0 — v(0? show 
that 0(0 = u(0 + v(0> where u(0 is the general solution of the homogeneous system 
x 7 = P(0x. 

17. Consider the initial value problem 

x ; = Ax + g(0, x(0) = x°. 

(a) By referring to Problem 15(c) in Section 7.7, show that 


x = $(0x° + 


/' 


&(t — OgCO ds. 
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(b) Show also that 


x = exp(At)x° + f exp [A(t - 
Jo 


s)]g(s) ds. 


Compare these results with those of Problem 27 in Section 3.6. 

18. Use the Laplace transform to solve the system 
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8 


Up to this point we have discussed methods for solving differential equations by using 
analytical techniques such as integration or series expansions. Usually, the emphasis 
was on finding an exact expression for the solution. Unfortunately, there are many 
important problems in engineering and science, especially nonlinear ones, to which 
these methods either do not apply or are very complicated to use. In this chapter 
we discuss an alternative approach, the use of numerical approximation methods to 
obtain an accurate approximation to the solution of an initial value problem. We 
present these methods in the simplest possible context, namely, a single scalar first 
order equation. However, they can readily be extended to systems of first order 
equations, and this is outlined briefly in Section 8.5. The procedures described here 
can be executed easily on personal computers. 


8.1 The Euler or Tangent Line Method 


To discuss the development and use of numerical approximation procedures, we 
will concentrate mainly on the first order initial value problem consisting of the 
differential equation 



a) 


and the initial condition 


( 2 ) 


y(to) = yo- 


We assume that the functions/ and/ v are continuous on some rectangle in the ty-plane 
containing the point (to,yo)- Then, by Theorem 2.4.2, there exists a unique solution 
y = (pit) of the given problem in some interval about to- If Eq. (1) is nonlinear, then 
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the interval of existence of the solution may be difficult to determine and may have 
no simple relationship to the function /. However, in all our discussions we assume 
that there is a unique solution of the initial value problem (1), (2) in the interval of 
interest. 

In Section 2.7 we described the oldest and simplest numerical approximation 
method, namely, the Euler or tangent line method. To derive this method, let us 
write the differential equation (1) at the point t = t n in the form 

^(t n )=f[t n ,<Kt n )]. (3) 

Then we approximate the derivative in Eq. (3) by the corresponding (forward) 
difference quotient, obtaining 


0 (^ 7 + 1 ) 0 (^«) 

tn+1 t n 




(4) 


Finally, if we replace 0fc+i) and 0(t w ) by their approximate values y n+ \ and y n , 
respectively, and solve for y n+ 1 , we obtain the Euler formula 


yn+ 1 — yn T f (t n , y n )(t n -\-l t n ), Tl — 0, 1,2, ... . (5) 


If the step size t n+ \ — t n has a uniform value h for all n and if we denote f(t n ,y n ) by 
f n , then Eq. (5) simplifies to 


y n + 1 = y n + hfn , n = 0,1,2,.... (6) 

Euler’s method consists of repeatedly evaluating Eq. (5) or (6), using the result 
of each step to execute the next step. In this way we obtain a sequence of values 
yo,yi,y 2 , • • • ,y/ 7 , • • • that approximate the values of the solution 0(t) at the points 
^0 ? t\ , ? • • • ? tn •> • • • • 

A computer program for Euler’s method has a structure such as that shown below. 
The specific instructions can be written in any convenient programming language. 



The Euler Method 

Step 1. 

define f(t,y) 

Step 2. 

input initial values tO and yO 

Step 3. 

input step size h and number of steps n 

Step 4. 

output tO and yO 

Step 5. 

for j from 1 to n do 

Step 6. 

7^ 

II 

t-H 


y = y + h * k\ 


t — t T h 

Step 7. 

output t and y 

Step 8. 

end 
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Some examples of Euler’s method appear in Section 2.7. As another example, 
consider the initial value problem 


y = 1 — t + 4y, (7) 

y(0) = l. (8) 

Equation (7) is a first order linear equation, and you can easily verify that the solution 
satisfying the initial condition (8) is 

y = 4>(t ) = \t - b + il e4r - ( 9 ) 

Since the exact solution is known, we do not need numerical methods to approx¬ 
imate the solution of the initial value problem (7), (8). On the other hand, the 
availability of the exact solution makes it easy to determine the accuracy of any 
numerical procedure that we use on this problem. We will use this problem through¬ 
out the chapter to illustrate and compare different numerical methods. The solutions 
of Eq. (7) diverge rather rapidly from each other, so we should expect that it will 
be fairly difficult to approximate the solution (9) well over any interval of moder¬ 
ate length. Indeed, this is the reason for choosing this particular problem; it will be 
relatively easy to observe the benefits of using more efficient methods. 


Using the Euler formula (6) and step sizes h = 0.05,0.025,0.01, and 0.001, determine approx¬ 
imate values of the solution y = of the problem (7), (8) on the interval 0 < t < 2. 

The indicated calculations were carried out on a computer, and some of the results are shown 
in Table 8.1.1. Their accuracy is not particularly impressive. For h = 0.01 the percentage error 
is 3.85% at t = 0.5, 7.49% at t = 1.0, and 14.4% at t — 2.0. The corresponding percentage 
errors for h = 0.001 are 0.40%, 0.79%, and 1.58%, respectively. Observe that if h = 0.001, 
then it requires 2000 steps to traverse the interval from t = 0 to t = 2. Thus considerable 
computation is needed to obtain even reasonably good accuracy for this problem using the 
Euler method. When we discuss other numerical approximation methods later in this chapter, 
we will find that it is possible to obtain comparable or better accuracy with much larger step 
sizes and many fewer computational steps. 


TABLE 8.1.1 A Comparison of Results for the Numerical Approximation of the Solution 
of y' = 1 - t + 4y,y(0) = 1 Using the Euler Method for Different Step Sizes h 


t 

h = 0.05 

h = 0.025 

h = 0.01 

h = 0.001 

Exact 

0.0 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

0.1 

1.5475000 

1.5761188 

1.5952901 

1.6076289 

1.6090418 

0.2 

2.3249000 

2.4080117 

2.4644587 

2.5011159 

2.5053299 

0.3 

3.4333560 

3.6143837 

3.7390345 

3.8207130 

3.8301388 

0.4 

5.0185326 

5.3690304 

5.6137120 

5.7754845 

5.7942260 

0.5 

7.2901870 

7.9264062 

8.3766865 

8.6770692 

8.7120041 

1.0 

45.588400 

53.807866 

60.037126 

64.382558 

64.897803 

1.5 

282.07187 

361.75945 

426.40818 

473.55979 

479.25919 

2.0 

1745.6662 

2432.7878 

3029.3279 

3484.1608 

3540.2001 
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To begin to investigate the errors in using numerical approximations, and also to 
suggest ways to construct more accurate algorithms, it is helpful to mention some 
alternative ways to look at the Euler method. 

One way to proceed is to write the problem as an integral equation. Let y = 0(0 
be the solution of the initial value problem (1), (2); then, by integrating from t n to 
t n+ 1 , we obtain 

rtn+l rtn+1 

/ <p'(t)dt= / f[t,<p(t)]dt, 

Jt n Jt n 

or t 

0(Wl) = <Kt n ) + [ U+1 fit , 0(0] dt. (10) 

Jt n 


The integral in Eq. (10) is represented geometrically as the area under the curve in 
Figure 8.1.1 between t = t n and t = t n+ \. If we approximate the integral by replacing 
f\t , 0(0] by its value f[t n , (p(t n )] at t = t n , then we are approximating the actual area 
by the area of the shaded rectangle. In this way we obtain 


0(0+1) — 0(0) T/[Oj 0(0)](O+i 0) 

= 0(O) + A/[O,0(O)L (11) 


Finally, to obtain an approximation y n+ 1 for 0 (t n+ 1 ), we make a second approximation 
by replacing <f>(t n ) by its approximate value y n in Eq. (11). This gives the Euler formula 
y n+1 = y n + hf(t n ,y n ). A more accurate algorithm can be obtained by approximating 
the integral more accurately. This is discussed in Section 8.2. 



FIGURE 8.1.1 Integral derivation of the Euler method. 

Another approach is to assume that the solution y = 0(0 has a Taylor series about 
the point t n . Then 

h 2 

(j)(t n + h) = (/>(t n ) + 4>'(t n )h + + • • •, 

or 

h 2 

0(Wl) = 0fe) +/fe 5 0(^)]^ + + • • • . (12) 

If the series is terminated after the first two terms, and 0fe+ i) and <j)(t n ) are replaced 
by their approximate values y n+ ± and y n , we again obtain the Euler formula (6). If 
more terms in the series are retained, a more accurate formula is obtained. Further, 
by using a Taylor series with a remainder, it is possible to estimate the magnitude of 
the error in the formula. This is discussed later in this section. 
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EXAMPLE 

2 


The Backward Euler Formula. A variation on the Euler formula can be obtained by 
using the backward difference quotient p(t n ) — cp(t n -i)\/h to approximate the deri¬ 
vative in Eq. (3) instead of the forward difference quotient used in Eq. (4). In this 
way we obtain 

<Kt n ) - <Kt n - 1 ) = hf(t n ,y n ), 
or 

y n =y n -l +hf(t n ,y n ). 

Stepping the index up from n to n + 1, we obtain the backward Euler formula 

yn +1 = yn “i - hf (.t n +h y n +i)‘ (13) 

Assuming that y n is known and y n+ 1 is to be calculated, observe that Eq. (13) does not 
provide an explicit formula for y n +i- Rather, it is an equation that implicitly defines 
y n+ 1 and must be solved to determine the value of y n +i- How difficult this is depends 
entirely on the nature of the function /. 

Use the backward Euler formula (13) and step sizes h = 0.05, 0.025, 0.01, and 0.001 to find 
approximate values of the solution of the initial value problem (7), (8) on the interval 0 < t < 2. 
For this problem, the backward Euler formula (13) becomes 

y n +1 = yn + hQ- — t n + 1 + 4y n+ i). 

We will show the first two steps in detail so that it will be clear how the method works. At the 
first step we have 

yi = yo + h(l -t\+ 4yi) = 1 + (0.05)(1 - 0.05 + 4yi). 

Solving this equation for yi, we obtain 

y\ = 1.0475/0.8 = 1.309375. 

Observe that because the differential equation is linear, the implicit equation for y 1 is also 
linear and therefore easy to solve. Next, 

y 2 = y 1 + h( 1 — t 2 + 4y 2 ) = 1.309375 + (0.05)(1 — 0.1 + 4y 2 ), 

which leads to 

y 2 = 1.354375/0.8 = 1.69296875. 

Continuing the computations on a computer, we obtain the results shown in Table 8.1.2. 
The values given by the backward Euler method are uniformly too large for this problem, 


TABLE 8.1.2 A Comparison of Results for the Numerical Approximation of the Solution of 
y' = 1 — t + 4y,y(0) = 1 Using the Backward Euler Method for Different Step Sizes h 


t 

h = 0.05 

h = 0.025 

h = 0.01 

h = 0.001 

Exact 

0 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

0.1 

1.6929688 

1.6474375 

1.6236638 

1.6104634 

1.6090418 

0.2 

2.7616699 

2.6211306 

2.5491368 

2.5095731 

2.5053299 

0.3 

4.4174530 

4.0920886 

3.9285724 

3.8396379 

3.8301388 

0.4 

6.9905516 

6.3209569 

5.9908303 

5.8131282 

5.7942260 

0.5 

10.996956 

9.7050002 

9.0801473 

8.7472667 

8.7120041 

1.0 

103.06171 

80.402761 

70.452395 

65.419964 

64.897803 

1.5 

959.44236 

661.00731 

542.12432 

485.05825 

479.25919 

2.0 

8934.0696 

5435.7294 

4172.7228 

3597.4478 

3540.2001 
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whereas the values obtained from the Euler method were too small. In this problem the errors 
are somewhat larger for the backward Euler method than for the Euler method, although for 
small values of h the differences are insignificant. Since the backward Euler method appears 
to be no more accurate than the Euler method, and is somewhat more complicated, a natural 
question is why it should even be mentioned. The answer is that it is the simplest example of a 
class of methods known as backward differentiation formulas that are very useful for certain 
types of differential equations. We will return to this issue later in this chapter. 

Errors in Numerical Approximations. The use of a numerical procedure, such as the Euler 
formula, on an initial value problem raises a number of questions that must be 
answered before the approximate numerical solution can be accepted as satisfac¬ 
tory. One of these is the question of convergence. That is, as the step size h tends 
to zero, do the values of the numerical approximation yi,y 2 , • • • , 3 ^, • • • approach the 
corresponding values of the actual solution? If we assume that the answer is affir¬ 
mative, there remains the important practical question of how rapidly the numerical 
approximation converges to the solution. In other words, how small a step size is 
needed in order to guarantee a given level of accuracy? We want to use a step size 
that is small enough to ensure the required accuracy, but not too small. An unneces¬ 
sarily small step size slows down the calculations and in some cases may even cause 
a loss of accuracy. 

There are three fundamental sources of error in approximating the solution of an 
initial value problem numerically. 

1. The formula, or algorithm, used in the calculations is an approximate one. For instance, 
the Euler formula uses straight-line approximations to the actual solution. 

2. Except for the first step, the input data used in the calculations are only approximations 
to the actual values of the solution at the specified points. 

3. The computer used for the calculations has finite precision; in other words, at each stage 
only a finite number of digits can be retained. 

Let us temporarily assume that our computer can execute all computations exactly; 
that is, it can retain infinitely many digits (if necessary) at each step. Then the dif¬ 
ference E n between the solution y = 0(0 of the initial value problem (1), (2) and its 
numerical approximation y n at the point t = t n is given by 


(14) 


En — 0(f«) yn- 


The error E n is known as the global truncation error. It arises entirely from the 
first two error sources listed above—that is, by applying an approximate formula to 
approximate data. 

However, in reality we must carry out the computations using finite precision 
arithmetic, which means that we can keep only a finite number of digits at each step. 
This leads to a round-off error R n defined by 


(15) 



where Y n is the value actually computed from the given numerical method. 
The absolute value of the total error in computing (j){t n ) is given by 


10(f/i) Yn\ — 10(4z) yn T yn Y n \. 


( 16 ) 




8.1 The Euler or Tangent Line Method 


457 


Making use of the triangle inequality, \a + b\ < \a\ + \b\, we obtain, from Eq. (16), 

10(4) Y n \ — 10(4) 34 I T I yn Y n \ 

< \E n \ + \R n \. (17) 

Thus the total error is bounded by the sum of the absolute values of the global 
truncation and round-off errors. For the numerical procedures discussed in this book, 
it is possible to obtain useful estimates of the global truncation error. The round-off 
error is more difficult to analyze, since it depends on the type of computer used, the 
sequence in which the computations are carried out, the method of rounding off, and 
so forth. A careful examination of round-off error is beyond the scope of this book, 
but see, for example, the book by Henrici listed in the references. Some of the dangers 
from round-off error are discussed in Problems 25 through 27 and in Section 8 . 6 . 

It is often useful to consider separately the part of the global truncation error that 
is due only to the use of an approximate formula. We can do this by assuming at the 
nth step that the input data are accurate — that is, that y n = 0(4). This error is known 
as the local truncation error; we will denote it by e n . 

Local Truncation Error for the Euler Method. Let us assume that the solution y = 0 (t) of 
the initial value problem ( 1 ), ( 2 ) has a continuous second derivative in the interval 
of interest. To ensure this, we can assume that /,/, and f y are continuous. For if / has 
these properties and if 0 is a solution of the initial value problem ( 1 ), ( 2 ), then 

0 '(O=/[*, 0 (OL 

and, by the chain rule, 

0 "(O=^P, 0 (O]+/ y [^ 0 (O] 0 '(O 

(is) 

Since the right side of this equation is continuous, 0 " is also continuous. 

Then, making use of a Taylor polynomial with a remainder to expand 0 about 4 , 
we obtain 

0(4 + h) = 0(4) + (j)\t n )h + | (/)"(t n )h 2 , (19) 

where t n is some point in t n < t n < t n + h. Then, noting that 0(4 + h) = 0(4+ 1 ) and 
0/4) = f[t n , 0(4)], we can rewrite Eq. (19) as 

<Ktn+ 1 ) = + hf[t n ,4>(t n )] + \<t>" (t n )h 2 . ( 20 ) 

Now let us use the Euler formula to calculate an approximation to 0(4+i) under 
the assumption that we know the correct value for y n at 4 , namely y n = 0(4). The 
result is 

y* n+ i = 0(4) + ^/[4j0(4)L (21) 

where the asterisk is used to designate this hypothetical approximate value for 
0 ( 4 +i). The difference between 0(4+i) and y * +1 is the local truncation error for the 
( n + l)st step in the Euler method, which we will denote by e n+ \. Thus, by subtracting 
Eq. (21) from Eq. (20), we find that 

e n +l = <p(tn+ 1 ) - y*n +1 = \<t>"(tn)h 2 , 
since the remaining terms in Eqs. (20) and (21) cancel. 


(22) 
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Thus the local truncation error for the Euler method is proportional to the square of 
the step size h, and the proportionality factor depends on the second derivative of the 
solution 0. The expression given by Eq. (22) depends on n and, in general, is different 
for each step. A uniform bound, valid on an interval [ a , b], is given by 

\e n \<Mh 2 /2, (23) 

where M is the maximum of \<t>"(t)\ on the interval [a, b]. Since Eq. (23) is based 
on a consideration of the worst possible case—that is, the largest possible value of 
10" (01—it may well be a considerable overestimate of the actual local truncation 
error in some parts of the interval [a, b]. 

One use of Eq. (23) is to choose a step size that will result in a local truncation error 
no greater than some given tolerance level. For example, if the local truncation 
error must be no greater than e, then from Eq. (23) we have 

Mh 1 / 2 <e or h< ^2e/M. (24) 

The primary difficulty in using Eq. (22), (23), or (24) lies in estimating |0"(f)| or M. 
However, the central fact expressed by these equations is that the local truncation 
error is proportional to h 2 . For example, if a new value of h is used that is one-half of 
its original value, then the resulting error will be reduced to one-fourth of its previous 
value. 

More important than the local truncation error is the global truncation error E n . 
The analysis for estimating E n is much more difficult than that for e n . Nevertheless, 
it can be shown that the global truncation error in using the Euler method on a finite 
interval is no greater than a constant times h. Thus 

\E n \ < Kh (25) 

for some constant K ; see Problem 23 for more details. The Euler method is called 
a first order method because its global truncation error is proportional to the first 
power of the step size. 

Because it is more accessible, we will hereafter use the local truncation error as our 
principal measure of the accuracy of a numerical method and for comparing different 
methods. If we have a priori information about the solution of the given initial value 
problem, we can use the result (22) to obtain more precise information about how the 
local truncation error varies with t. As an example, consider the illustrative problem 

y = l -t + 4y, y(0) = 1 (26) 

on the interval 0 < t < 2. Let y = 0(t) be the solution of the initial value problem 
(26). Then, as noted previously, 

0(f) = (4f - 3 + 19e 4r )/16 

and therefore 

0"(f) = 19e 4 '. 


Equation (22) then states that 


19e 47 »/f 2 


&n +1 — 


2 


tn ^ tn ^ tn T h. 


(27) 
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The appearance of the factor 19 and the rapid growth of e 4t explain why the results 
in Table 8.1.1 are not very accurate. 

For instance, for h = 0.05 the error in the first step is 


19^° (0.0025) 
ei = Hh) -y i =- -z - 


0 < to < 0.05. 


It is clear that e\ is positive, and since e 4 ^° < e 02 , we have 


ei < 


19c 0,2 (0.0025) 
2 


0.02901. 


(28) 


Note also that e 4t ° > 1; hence e\ > 19(0.0025)/2 = 0.02375. The actual error is 
0.02542. It follows from Eq. (27) that the error becomes progressively worse 
with increasing t\ this is also clearly shown by the results in Table 8.1.1. Similar 
computations for bounds for the local truncation error give 


19e 38 (0.0025) ^ ^ 19e 4 (0.0025) „ 1 

1.0617 =---< e2o <---= 1.2967 


(29) 


in going from 0.95 to 1.0 and 


57.96 


19e 7 ' 8 (0.0025) 

2 


19e 8 (0.0025) 
< C40 <-x- 


70.80 


(30) 


in going from 1.95 to 2.0. 

These results indicate that for this problem, the local truncation error is about 2500 
times larger near t = 2 than near t = 0. Thus, to reduce the local truncation error to 
an acceptable level throughout 0 < t < 2, we must choose a step size h based on an 
analysis near t = 2. Of course, this step size will be much smaller than necessary near 
t = 0. For example, to achieve a local truncation error of 0.01 for this problem, we 
need a step size of about 0.00059 near t = 2 and a step size of about 0.032 near t = 0. 
The use of a uniform step size that is smaller than necessary over much of the interval 
results in more calculations than necessary, more time consumed, and possibly more 
danger of unacceptable round-off errors. 

Another approach is to keep the local truncation error approximately constant 
throughout the interval by gradually reducing the step size as t increases. In the 
example problem, we would need to reduce h by a factor of about 50 in going from 
t = 0 to t = 2. A method that provides for variations in the step size is called adaptive. 
All modern computer codes for solving differential equations have the capability of 
adjusting the step size as needed. We will return to this question in the next section. 
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PROBLEMS In each of Problems 1 through 6, find approximate values of the solution of the given initial 
value problem at t = 0.1,0.2,0.3, and 0.4. 

(a) Use the Euler method with h = 0.05. 

(b) Use the Euler method with h = 0.025. 

(c) Use the backward Euler method with h = 0.05. 

(d) Use the backward Euler method with h = 0.025. 


41 

1. y' = 3 +t-y, 

y{ 0) = l 

41 

2. y = 5t - 3 Jy, 

y(0) = 2 

41 

3. y = 2y — 3 1, 

y(0) = l 

41 

4. y = it + e~‘y, 

y(0) = l 

41 

5./, ,2 + 2 f, 

y 3 + t 2 

y(0) = 0.5 

41 

6. y = ( t 2 — y 2 ) siny, 

y(0) 


In each of Problems 7 through 12, find approximate values of the solution of the given initial 
value problem at t = 0.5,1.0,1.5, and 2.0. 

(a) Use the Euler method with h = 0.025. 

(b) Use the Euler method with h = 0.0125. 

(c) Use the backward Euler method with h = 0.025. 

(d) Use the backward Euler method with h = 0.0125. 


41 

7. y = 0.5 - t + 2 y, y( 0) = 1 

41 8. y = St - 3 Jy, 

y( 0) = 2 

41 

9. y = yr+y, y(0) = 3 

41 10- y = 2t + e-'y. 

y(0) = i 

41 

11. / = (4-007(1+/), y(0) = 

-2 



4fl 12. y = (y 2 + 200/(3 + t 2 ), y(0) = 0.5 

13. Complete the calculations leading to the entries in columns three and four of Table 8.1.1. 

14. Complete the calculations leading to the entries in columns three and four of Table 8.1.2. 

15. Using three terms in the Taylor series given in Eq. (12) and taking h = 0.1, determine 
approximate values of the solution of the illustrative example / = 1 — t + 4y,y(0) = 1 at 
t = 0.1 and 0.2. Compare the results with those using the Euler method and with the exact 
values. 

Hint: If y' = f(t,y ), what is y"l 

In each of Problems 16 and 17, estimate the local truncation error for the Euler method in 
terms of the solution y = Obtain a bound for e n+ \ in terms of t and 0(0 that is valid on 
the interval 0 < t < 1. By using a formula for the solution, obtain a more accurate error bound 
for e n+ i . For h = 0.1 compute a bound for e\ and compare it with the actual error at t = 0.1. 
Also compute a bound for the error e 4 in the fourth step. 

16. y = 2y- 1, y( 0) = 1 17. / = § - t + 2y, y( 0) = 1 


In each of Problems 18 through 21, obtain a formula for the local truncation error for the Euler 
method in terms of t and the solution 0. 

18. y = t 2 + y 2 , y( 0) = 1 19. / = 5t - 3 ^/y, y(0) = 2 

20. / = Jt + y, y( 1) = 3 21. y = 2t + y( 0) = 1 

41 22. Consider the initial value problem 


y' = COS 5jrt, 


3 * 0 ) = 1 . 
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(a) Determine the solution y = 0(0, and draw a graph of y = 0(0 for 0 < t < 1. 

(b) Determine approximate values of 0(0 at t = 0.2,0.4, and 0.6 using the Euler method 
with h = 0.2. Draw a broken-line graph for the approximate solution, and compare it with 
the graph of the exact solution. 

(c) Repeat the computation of part (b) for 0 < t < 0.4, but take h = 0.1. 

(d) Show by computing the local truncation error that neither of these step sizes is suffi¬ 
ciently small. Determine a value of h to ensure that the local truncation error is less than 
0.05 throughout the interval 0 < t < 1. That such a small value of h is required results from 
the fact that max |0"(O| is large. 


23. In this problem we discuss the global truncation error associated with the Euler method 
for the initial value problem y' = f(t,y ), y(to) = yo- Assuming that the functions / and f y 
are continuous in a closed, bounded region R of the ty-plane that includes the point (t 0 , yo), 
it can be shown that there exists a constant L such that | f(t,y) — f(t,y\ < L\y — y\, where 
(t,y) and (t,y) are any two points in R with the same t coordinate (see Problem 15 of 
Section 2.8). Further, we assume that f t is continuous, so the solution 0 has a continuous 
second derivative. 

(a) Using Eq. (20), show that 

l-En+il £ \E n \+h\f[t n ,4>(t„)] — f(t n ,y n )\ + \h 2 \f(t n )| < a\E n \ +fih 2 , (i) 


where a = 1 + hL and p = max | 0 "(f )|/2 on to < t < t n . 

(b) Assume that if E 0 = 0, and if \E n \ satisfies Eq. (i), then \E n \ < ph 2 (a n — l)/(a — 1) 
for a 7 ^ 1. Use this result to show that 


\E n \< 


(1 + hL) n - 1 
L 


ph. 


(ii) 


Equation (ii) gives a bound for \E n \m terms of h, L, n, and p. Notice that for a fixed h, this 
error bound increases with increasing n\ that is, the error bound increases with distance 
from the starting point t 0 . 

(c) Show that (1 + hL) n < e nhL ; hence 


\E n \< 



ph . 


If we select an ending point T greater than to and then choose the step size h so that n 
steps are required to traverse the interval [to, T], then nh = T — to, and 


g(T—to)L _ ^ 

\E n I < - — - ph = Kh , 


which is Eq. (25). Note that K depends on the length T — t 0 of the interval and on the 
constants L and p that are determined from the function /. 

24. Derive an expression analogous to Eq. (22) for the local truncation error for the backward 
Euler formula. 

Hint: Construct a suitable Taylor approximation to 0(0 about t = t n+ 1 . 

25. Using a step size h = 0.05 and the Euler method, but retaining only three digits throughout 
the computations, determine approximate values of the solution at t = 0.1, 0.2, 0.3, and 
0.4 for each of the following initial value problems: 

(a) / = 1 - t + 4y, y( 0) = 1 

(b) / = 3 +t-y, y(0 ) = 1 

(c) y' = 2y- 3 1, y(0) = 1 
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Compare the results with those obtained in Example 1 and in Problems 1 and 3. The 
small differences between some of those results rounded to three digits and the present 
results are due to round-off error. The round-off error would become important if the 
computation required many steps. 

26. The following problem illustrates a danger that occurs because of round-off error when 
nearly equal numbers are subtracted and the difference is then multiplied by a large 
number. Evaluate the quantity 


1000 * 


6.010 

2.004 


18.04 

6.000 


in the following ways: 

(a) First round each entry in the determinant to two digits. 

(b) First round each entry in the determinant to three digits. 

(c) Retain all four digits. Compare this value with the results in parts (a) and (b). 

27. The distributive law a(b — c) = ab — ac does not hold, in general, if the products are 
rounded off to a smaller number of digits. To show this in a specific case, take a = 0.22, 
b = 3.19, and c = 2.17. After each multiplication, round off the last digit. 


8.2 Improvements on the Euler Method 


Since for many problems the Euler method requires a very small step size to produce 
sufficiently accurate results, much effort has been devoted to the development of 
more efficient methods. In the next three sections, we will discuss some of these 
methods. Consider the initial value problem 

y'=f(t,y), y(to) = yo (l) 


and let y = 0(7) denote its solution. Recall from Eq. (10) of Section 8.1 that by 
integrating the given differential equation from t n to t n + 1 , we obtain 


0(6z+i) — 0(6?) T 



, 0 ( 0 ]*- 


The Euler formula 


y n +1 = y n + hf(t n ,y n ) 


( 2 ) 

( 3 ) 


is obtained by replacing/[7,0(0] in Eq. (2) by its approximate value f(t n ,y n ) at the 
left endpoint of the interval of integration. 


Improved Euler Formula. A better approximate formula can be obtained if the 
integrand in Eq. (2) is approximated more accurately. One way to do this is to 
replace the integrand by the average of its values at the two endpoints, namely, 
{f[t n ,(p(t n )] +/[6i+i,0(Wi)]}/ 2. This is equivalent to approximating the area under 
the curve in Figure 8.2.1 between t = t n and t = t n+ 1 by the area of the shaded 
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trapezoid. Further, we replace (p(t n ) and <t>(t n+ 1 ) by their respective approximate 
values y n and y n +i- In this way we obtain, from Eq. (2), 

. f(tn,yn) +f(f n +uy n +l ) 1 , A , 

y n + 1 = y n + - - - n. (4) 

Since the unknown y n+ \ appears as one of the arguments of / on the right side of 
Eq. (4), this equation defines y n+ \ implicitly rather than explicitly. Depending on 
the nature of the function/, it may be fairly difficult to solve Eq. (4) for y n +i- This 
difficulty can be overcome by replacing y n+ i on the right side of Eq. (4) by the value 
obtained using the Euler formula (3). Thus 

, f(t n ,y n )+f[t n + h,y n + hf(t n ,y n )\ 

y n +1 = y n +-2- h 

. fn + f(tn + h y y n + hf n ) 

= yn + - 2 -( 5 ) 

where t n+ 1 has been replaced by t n + h. 



FIGURE 8.2.1 Derivation of the improved Euler method. 


Equation (5) gives an explicit formula for computing y n + 1 , the approximate value 
of (p(t n+ 1 ), in terms of the data at t n . This formula is known as the improved Euler 
formula or the Heun 1 formula. The improved Euler formula is an example of a two- 
stage method; that is, we first calculate y n + hf n from the Euler formula and then 
use this result to calculate y n+ \ from Eq. (5). The improved Euler formula (5) is an 
improvement over the Euler formula (3) because the local truncation error in using 
Eq. (5) is proportional to h 3 , while for the Euler method it is proportional to h 2 . This 
error estimate for the improved Euler formula is established in Problem 14. It can also 
be shown that for a finite interval, the global truncation error for the improved Euler 
formula is bounded by a constant times h 2 , so this method is a second order method. 
Note that this greater accuracy is achieved at the expense of more computational 
work, since it is now necessary to evaluate f(t,y ) twice in order to go from t n to t n+ \. 


lr The formula is named for the German mathematician Karl Heun (1859-1929), who was a professor at 
Technische Hochschule Karlsruhe. 
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EXAMPLE 

1 


If f(t,y) depends only on t and not on y, then solving the differential equation 
y' =f(t,y ) reduces to integrating/(t). In this case the improved Euler formula (5) 
becomes 

h 

y n + 1 - y,l = 2 I fttn) +f(tn + h)l (6) 

which is just the trapezoid rule for numerical integration. 


Use the improved Euler formula (5) to calculate approximate values of the solution of the 
initial value problem 

y = l-t + 4y, y(0) = 1. (7) 

To make clear exactly what computations are required, we show a couple of steps in detail. 
For this problem f(t,y) = 1 — £ + 4y; hence 

fn = 1 — t n + 4 y n 

and 

f(t n + h,y n + hfn) = 1 — (t n + h) + 4 (y n + hf n ). 

Further, to = 0,y 0 = 1, and/o = 1 — to + 4y 0 = 5. If h = 0.025, then 

/(to + h 9 y 0 + hf 0 ) = 1 - 0.025 + 4[1 + (0.025)(5)] = 5.475. 

Then, from Eq. (5), 

yi = l + (0.5) (5 + 5.475)(0.025) = 1.1309375. (8) 

At the second step we must calculate 

/i = 1 - 0.025 + 4(1.1309375) = 5.49875, 
yi + hf x = 1.1309375 + (0.025) (5.49875) = 1.26840625, 

and 

f(t 2 ,yx + hf{) = 1 - 0.05 + 4(1.26840625) = 6.023625. 

Then, from Eq. (5), 

y 2 = 1.1309375 + (0.5)(5.49875 + 6.023625) (0.025) = 1.2749671875. (9) 

Further results for 0 < t < 2 obtained by using the improved Euler method with h = 0.025 
and h — 0.01 are given in Table 8.2.1. To compare the results of the improved Euler method with 
those of the Euler method, note that the improved Euler method requires two evaluations of 
/ at each step, while the Euler method requires only one. This is significant because typically, 
most of the computing time in each step is spent in evaluating /, so counting these evalua¬ 
tions is a reasonable way to estimate the total computing effort. Thus, for a given step size h , 
the improved Euler method requires twice as many evaluations of / as the Euler method. 
Alternatively, the improved Euler method for step size h requires the same number of eval¬ 
uations of / as the Euler method for step size h/2. 

By referring to Table 8.2.1, you can see that the improved Euler method with h = 0.025 gives 
much better results than the Euler method with h = 0.01. Note that to reach t = 2 with these 
step sizes, the improved Euler method requires 160 evaluations of /, while the Euler method 
requires 200. More noteworthy is that the improved Euler method with h = 0.025 is also 
slightly more accurate than the Euler method with h = 0.001 (2000 evaluations of/). In other 
words, with something like one-twelfth of the computing effort, the improved Euler method 
yields results for this problem that are comparable to, or a bit better than, those generated by 
the Euler method. This illustrates that, compared to the Euler method, the improved Euler 
method is clearly more efficient, yielding substantially better results or requiring much less 
total computing effort, or both. 
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TABLE 8.2.1 A Comparison of Results Using the Euler and Improved Euler Methods for 
the Initial Value Problem y' = 1 — t + 4y, y (0) = 1 


t 

Euler 

Improved Euler 


h = 0.01 

h = 0.001 

h = 0.025 

h = 0.01 

Exact 

0 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

0.1 

1.5952901 

1.6076289 

1.6079462 

1.6088585 

1.6090418 

0.2 

2.4644587 

2.5011159 

2.5020618 

2.5047827 

2.5053299 

0.3 

3.7390345 

3.8207130 

3.8228282 

3.8289146 

3.8301388 

0.4 

5.6137120 

5.7754845 

5.7796888 

5.7917911 

5.7942260 

0.5 

8.3766865 

8.6770692 

8.6849039 

8.7074637 

8.7120041 

1.0 

60.037126 

64.382558 

64.497931 

64.830722 

64.897803 

1.5 

426.40818 

473.55979 

474.83402 

478.51588 

479.25919 

2.0 

3029.3279 

3484.1608 

3496.6702 

3532.8789 

3540.2001 


The percentage errors at t = 2 for the improved Euler method are 1.23% for h = 0.025 and 
0 .21% for h = 0.01. 


A computer program for the Euler method can be readily modified to implement 
the improved Euler method instead. All that is required is to replace Step 6 in the 
algorithm in Section 8.1 by the following: 


The Improved Euler Method 
Step 6. kl=f(t,y) 

k2 = fit + h,y + h * kl) 
y = y + (h/2) * (kl + kl) 
t = t T h 


Variation of Step Size. In Section 8.1 we mentioned the possibility of adjusting the 
step size as a calculation proceeds so as to maintain the local truncation error at 
a more or less constant level. The goal is to use no more steps than necessary 
and, at the same time, to keep some control over the accuracy of the approxi¬ 
mation. Here we will describe how this can be done. First we choose the error 
tolerance 6, which is the local truncation error that we are willing to accept. Sup¬ 
pose that after n steps we have reached the point (t n ,y n ). We choose a step size 
h and calculate y n +i- Next we need to estimate the error we have made in calcu¬ 
lating y n+ 1 . Not knowing the actual solution, the best that we can do is to use a 
more accurate method and repeat the calculation starting from (t n ,y n ). For exam¬ 
ple, if we used the Euler method for the original calculation, we might repeat it 
with the improved Euler method. Then the difference between the two calculated 
values is an estimate e^ x of the error in using the original method. If the esti¬ 
mated error is different from the error tolerance 6, then we adjust the step size 
and repeat the calculation. The key to making this adjustment efficiently is know¬ 
ing how the local truncation error e n+ \ depends on the step size h. For the Euler 
method, the local truncation error is proportional to h 2 , so to bring the estimated error 
down (or up) to the tolerance level 6, we must multiply the original step size by the 
factor \Ze/e™l v 
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To illustrate this procedure, consider the example problem (7): 

/ = 1 -t + 4 y, y(0) = l. 

Suppose that we choose the error tolerance 6 to be 0.05. You can verify that after one 
step with h = 0.1, we obtain the values 1.5 and 1.595 from the Euler method and the 
improved Euler method, respectively. Thus the estimated error in using the Euler 
method is 0.095. Since this is larger than the tolerance level of 0.05, we need to adjust 
the step size downward by the factor ^0.05/0.095 = 0.73. Rounding downward to 
be conservative, let us choose the adjusted step size h = 0.07. Then, from the Euler 
formula, we obtain 

yi = l + (0.07)/(0,1) = 1.35 = 0(0.07). 

Using the improved Euler method, we obtain yi = 1.39655, so the estimated error in 
using the Euler formula is 0.04655, which is slightly less than the specified tolerance. 
The actual error, based on a comparison with the solution itself, is somewhat greater, 
namely, 0.05122. 

We can follow the same procedure at each step of the calculation, thereby keeping 
the local truncation error approximately constant throughout the entire numerical 
process. Modern adaptive codes for solving differential equations adjust the step 
size in very much this way as they proceed, although they usually use more accurate 
formulas than the Euler and improved Euler formulas. Consequently, they are able 
to achieve both efficiency and accuracy by using very small steps only where they 
are really needed. 


PROBLEMS 


In each of Problems 1 through 6, find approximate values of the solution of the given initial 
value problem at t = 0.1, 0.2, 0.3, and 0.4. Compare the results with those obtained by the 
Euler method and the backward Euler method in Section 8.1 and with the exact solution (if 
available). 

(a) Use the improved Euler method with h = 0.05. 

(b) Use the improved Euler method with h = 0.025. 


y(0) = 2 
y(0) = 1 



(c) 

Use the improved Euler method with h = 

0.0125. 

4fl 

1 . 

X. 

II 

+ 

1 

Vs- 

y(0) = l 

41 

2 . y' = 5t- 3y/y, 

41 

3. 

cn 

1 

<n' 

II 

V, 

y(0) = l 

41 

4. y = 2 1 + e~' y , 

41 

5. 

y 2 + 2 ty 
y 3 + t 2 

y(0) = 0.5 

41 

6 . y' = ( t 2 — y 2 ) siny, 


y(0) = -1 


In each of Problems 7 through 12, find approximate values of the solution of the given initial 
value problem at t = 0.5,1.0,1.5, and 2.0. 

(a) Use the improved Euler method with h = 0.025. 

(b) Use the improved Euler method with h = 0.0125. 

4fl 7. y' = 0.5 — t + 2y, y(0) = 1 4fl 8. y' = 5t - 3 Jy, v(0) = 2 

41 9. y = yr+y y(0) = 3 10. / = it + e-y yo) = 1 

4fl ii. y = (4 - oo/a+/>, >-(0) = -2 

12. y = (y 2 + 200/(3 + t 2 ), y(0) = 0.5 

13. Complete the calculations leading to the entries in columns four and five of Table 8.2.1. 
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14. In this problem we establish that the local truncation error for the improved Euler for¬ 
mula is proportional to h 3 . If we assume that the solution 0 of the initial value problem 
y' = f(t,y),y(to) = yo has derivatives that are continuous through the third order (/ has 
continuous second partial derivatives), then it follows that 

. 0 "( 4 ) 9 , 

0(4 + h) = 0 ( 4 ) + 0 (t n )h H- ——h 4 - ——h , 

where 4 <4 < t n + h. Assume that y n — 0(4). 

(a) Show that, for y n+ i as given by Eq. (5), 


*4+1 — 0(4+l) }4+1 

f/Un + 4>'"(t„)h 3 

=-2!- W 

(b) Making use of the facts that 0"(f) = /T40(Ol +/ y [4 0(010'(0 and that the Taylor 
approximation with a remainder for a function F(t,y ) of two variables is 


F(a + h,b + k) = F(a , 6 ) + F t (a, b)h + / 4 O 2 , 6 )& 



(h 2 F tt + 2 hkF t y + k 2 F yy ) 


x=t;,y=ri 


where £ lies between a and a + h, and 77 lies between b and b + show that the first term 
on the right side of Eq. (i) is proportional to h 3 plus higher order terms. This is the desired 
result. 

(c) Show that if f(t,y ) is linear in t and y, then e n+ i = 4>'"(t n )h 3 /6 for some t n with 

4 < 4 < 4+i* 

Hint: What are f tt , f ty , and ^ ? 


15. Consider the improved Euler method for solving the illustrative initial value problem 
/ = 1 — t + 4y,y(0) = 1. Using the result of Problem 14(c) and the exact solution of the 
initial value problem, determine e n+ i and a bound for the error at any step on 0 < t < 2. 
Compare this error with the one obtained in Eq. (27) of Section 8.1 using the Euler method. 
Also obtain a bound for e\ for h = 0.05, and compare it with Eq. (28) of Section 8.1. 

In each of Problems 16 and 17, use the actual solution 0(0 to determine e n+ i and a bound 
for e n+ i at any step on 0 < t < 1 for the improved Euler method for the given initial value 
problem. Also obtain a bound for e\ for h = 0.1, and compare it with the similar estimate for 
the Euler method and with the actual error for the improved Euler method. 

16. / = 2y - 1, y( 0) = 1 17. / = 0.5 - t + 2y, y(0) = 1 

In each of Problems 18 through 21, carry out one step of the Euler method and of the 
improved Euler method, using the step size h = 0.1. Suppose that a local truncation error 
no greater than 0.0025 is required. Estimate the step size that is needed for the Euler method 
to satisfy this requirement at the first step. 

18. y = 0.5 - t + 2 y, y( 0) = 1 19. / = 5t - 3^/y, y(0) = 2 

20 .y = Jt + y, y( 0)=3 21. / = (y 2 + 2ty)/(3 +1 2 ), y( 0) = 0.5 

22. The modified Euler formula for the initial value problem y' = f(t, y),y(4) = yo is given by 


y n +i — yn T hf\t n T 2 ^’14 T 2^/*(4>}4)]- 


Following the procedure outlined in Problem 14, show that the local truncation error in 
the modified Euler formula is proportional to h 3 . 
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In each of Problems 23 through 26, use the modified Euler formula of Problem 22 with h = 0.05 
to compute approximate values of the solution of the given initial value problem at t = 0.1, 
0.2,0.3, and 0.4. Compare the results with those obtained in Problems 1 through 4. 

fl23./ = 3 + t-y, y(0) = l 24. / = St - 3Jy, y( 0) = 2 

4fl 25. y' = 2y- 3 1, y(0) = 1 gl 26. / = It + <r* y( 0) = 1 

27. Show that the modified Euler formula of Problem 22 is identical to the improved Euler 
formula of Eq. (5) for y' = f(t,y) if / is linear in both t and y. 


8.3 The Runge-Kutta Method 


In preceding sections we have introduced the Euler formula, the backward Euler 
formula, and the improved Euler formula as ways to approximate the solution of the 
initial value problem 

y'=f(t,y ), y(to) = y 0 (i) 

numerically. The local truncation errors for these methods are proportional to h 2 ,h 2 , 
and h 3 , respectively. The Euler and improved Euler methods belong to what is now 
called the Runge-Kutta 2 class of methods. 

In this section we discuss the method originally developed by Runge and Kutta. 
This method is now called the classic fourth order four-stage Runge-Kutta method, 
but it is often referred to simply as the Runge-Kutta method, and we will follow this 
practice for brevity. This method has a local truncation error that is proportional 
to h 5 . Thus it is two orders of magnitude more accurate than the improved Euler 
method and three orders of magnitude better than the Euler method. It is relatively 
simple to use and is sufficiently accurate to handle many problems efficiently. This 
is especially true of adaptive Runge-Kutta methods, in which provision is made to 
vary the step size as needed. We return to this issue at the end of the section. 

The Runge-Kutta formula involves a weighted average of values of f(t,y ) at 
different points in the interval t n < t < t n + 1 . It is given by 


where 


. 7 ( kni + 2k n 2 + 2k n3 + k n 4 

y n +1 = y n + h I - - - 

knl = f(tn>yn)i 

k n 2 =f(tn + \h,y n + \hk n i), 

k n 3 =f(tn + \h,y n + \hk n2 ), 

k„4 = f (tn + h,y„ + hk n3 ). 


( 2 ) 


(3) 


2 Carl David Runge (1856-1927), a German mathematician and physicist, worked for many years in 
spectroscopy. The analysis of data led him to consider problems in numerical computation, and the Runge- 
Kutta method originated in his paper on the numerical solution of differential equations in 1895. The 
method was extended to systems of equations in 1901 by Martin Wilhelm Kutta (1867-1944). Kutta was 
a German mathematician and aerodynamicist who is also well known for his important contributions to 
classical airfoil theory. 
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The sum (k n \ + 2k n 2 + 2 k n 3 + k n f)/6 can be interpreted as an average slope. Note 
that k n i is the slope at the left end of the interval, k n 2 is the slope at the midpoint 
using the Euler formula to go from t n to t n + h/2 , k n 3 is a second approximation 
to the slope at the midpoint, and k n \ is the slope at t n + h using the Euler formula 
and the slope k n 3 to go from t n to t n + h. 

Although in principle it is not difficult to show that Eq. (2) differs from the Taylor 
expansion of the solution 0 by terms that are proportional to h 5 , the algebra is 
rather lengthy . 3 Thus we simply state without proof that the local truncation error 
in using Eq. (2) is proportional to h 5 and that for a finite interval the global trunca¬ 
tion error is at most a constant times h 4 . The earlier description of this method as a 
fourth order four-stage method reflects the facts that the global truncation error is 
of fourth order in the step size h and that there are four intermediate stages in the 
calculation (the calculation of k n i ,..., k n /f). 

Clearly the Runge-Kutta formula, Eqs. (2) and (3), is more complicated than any 
of the formulas discussed previously. This is of relatively little significance, however, 
since it is not hard to write a computer program to implement this method. Such a 
program has the same structure as the algorithm for the Euler method outlined in 
Section 8.1. To be specific, the lines in Step 6 in the Euler algorithm must be replaced 
by the following: 


The Runge-Kutta Method 
Step 6. kl=f(t,y ) 

k2 = fit + 0.5 * h,y + 0.5 * h * kl) 
k3 = fit + 0.5 * h,y + 0.5 * h * k2) 
k4 = fit + h, y + h * k3) 
y = y + ih/6) * (/cl + 2*/c2 + 2*/c3 + /c4) 
t = t T h 


Note that iff does not depend on y, then 

kni — f (tn)-> k n 2 = kri$ = f it n + h/ 2), k n 4 = f it n + /z), (4) 

and Eq. (2) reduces to 

3^i+i ~ yn — ~p\f (tn) + 4/ it n + h/2) -\-f(t n + h )]. (5) 

6 

Equation (5) can be identified as Simpson’s 4 rule for the approximate evaluation of 
the integral of y' = fit). The fact that Simpson’s rule has an error proportional to h 5 
is consistent with the local truncation error in the Runge-Kutta formula. 


3 See, for example, Chapter 3 of the book by Henrici listed in the references. 

4 Simpson’s rule is named for Thomas Simpson (1710-1761), an English mathematician and textbook 
author, who published it in 1743. 
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EXAMPLE 

1 


Use the Runge-Kutta method to calculate approximate values of the solution y = 4>{t) of the 
initial value problem 

y' = l-t + 4y, y( 0) = 1. (6) 

Taking h = 0.2, we have 

fcoi = /(0,1) = 5; hkoi = 1.0, 
ko2 — /(0 4- 0.1,1 T 0.5) = 6.9; hko2 — 1-38, 
k 03 = /(0 + 0.1,1 + 0.69) = 7.66; hk 03 = 1.532, 
k 04 = /(0 + 0.2,1 + 1.532) = 10.928. 

Thus 

yi = 1 + ^2 [5 + 2(6.9) + 2(7.66) + 10.928] 

6 

= 1 + 1.5016 = 2.5016. 

Further results using the Runge-Kutta method with h = 0.2, h = 0.1, and h = 0.05 are given 
in Table 8.3.1. Note that the Runge-Kutta method yields a value at t = 2 that differs from the 
exact solution by only 0.122% if the step size is h = 0.1, and by only 0.00903% if h = 0.05. 
In the latter case, the error is less than one part in 10,000, and the calculated value at t = 2 is 
correct to four digits. 

For comparison, note that both the Runge-Kutta method with h = 0.05 and the improved 
Euler method with h = 0.025 require 160 evaluations of / to reach t = 2. The improved Euler 
method yields a result at t = 2 that is in error by 1.23%. Although this error may be acceptable 
for some purposes, it is more than 135 times the error yielded by the Runge-Kutta method 
with comparable computing effort. Note also that the Runge-Kutta method with h = 0.2, or 
40 evaluations of/, produces a value at t = 2 with an error of 1.40%, which is only slightly 
greater than the error in the improved Euler method with h = 0.025, or 160 evaluations of/. 
Thus we see again that a more accurate algorithm is more efficient; it produces better results 
with similar effort, or similar results with less effort. 


TABLE 8.3.1 A Comparison of Results for the Numerical Approximation of the Solution 
of the Initial Value Problem y' = 1 - t + 4y, y (0) = 1 



Improved 

Euler 


Runge-Kutta 


Exact 

t 

h = 0.025 

<N 

O 

II 

II 

p 
M- 

h = 0.05 


0 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

1.0000000 

0.1 

1.6079462 


1.6089333 

1.6090338 

1.6090418 

0.2 

2.5020618 

2.5016000 

2.5050062 

2.5053060 

2.5053299 

0.3 

3.8228282 


3.8294145 

3.8300854 

3.8301388 

0.4 

5.7796888 

5.7776358 

5.7927853 

5.7941197 

5.7942260 

0.5 

8.6849039 


8.7093175 

8.7118060 

8.7120041 

1.0 

64.497931 

64.441579 

64.858107 

64.894875 

64.897803 

1.5 

474.83402 


478.81928 

479.22674 

479.25919 

2.0 

3496.6702 

3490.5574 

3535.8667 

3539.8804 

3540.2001 


The classic Runge-Kutta method suffers from the same shortcoming as other meth¬ 
ods with a fixed step size for problems in which the local truncation error varies 
widely over the interval of interest. That is, a step size that is small enough to achieve 
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satisfactory accuracy in some parts of the interval may be much smaller than neces¬ 
sary in other parts of the interval. This has stimulated the development of adaptive 
Runge-Kutta methods that provide for modifying the step size automatically as the 
computation proceeds, so as to maintain the local truncation error near or below a 
specified tolerance level. As explained in Section 8.2, this requires the estimation of 
the local truncation error at each step. One way to do this is to repeat the compu¬ 
tation with a fifth order method—which has a local truncation error proportional 
to h 6 —and then to use the difference between the two results as an estimate of the 
error. If this is done in a straightforward manner, then the use of the fifth order 
method requires at least five more evaluations off at each step, in addition to those 
required originally by the fourth order method. However, if we make an appropriate 
choice of the intermediate points and the weighting coefficients in the expressions for 
k n \,... ,k n 4 in a certain fourth order Runge-Kutta method, then these expressions 
can be used again, together with one additional stage, in a corresponding fifth order 
method. This results in a substantial gain in efficiency. It turns out that this can be 
done in more than one way. 

The first fourth and fifth order Runge-Kutta pair was developed by Erwin 
Fehlberg * * * * 5 6 in the late 1960s and is now called the Runge-Kutta-Fehlberg, or RKF, 6 
method. The popularity of the RKF method was considerably enhanced by the 
appearance in 1977 of its Fortran implementation RKF45 by Lawrence F. Shampine 
and H. A. Watts. The RKF method and other adaptive Runge-Kutta methods are very 
powerful and efficient means of approximating numerically the solutions of an enor¬ 
mous class of initial value problems. Specific implementations of one or more of them 
are widely available in commercial software packages. 


PROBLEMS In each of Problems 1 through 6, find approximate values of the solution of the given initial 

value problem at t = 0.1,0.2, 0.3, and 0.4. Compare the results with those obtained by using 
other methods and with the exact solution (if available). 

(a) Use the Runge-Kutta method with h = 0.1. 

(b) Use the Runge-Kutta method with h = 0.05. 

4fl 1 . y' = 3 + t-y, y(Q) = 1 jfl 2.? = 5t-3Jy, y( 0 ) = 2 

^ 3. / = 2y - 3 1, y(0) = 1 jfl 4. / = 2t + e~^, y(0) = 1 

41 5 - y= y (0) =°- 5 & 6 - y=^ - y 2 ) * ko) = -1 

In each of Problems 7 through 12, find approximate values of the solution of the given initial 
value problem at t = 0.5,1.0,1.5, and 2.0. Compare the results with those obtained by other 
methods. 

(a) Use the Runge-Kutta method with h = 0.1. 

(b) Use the Runge-Kutta method with h = 0.05. 


5 Erwin Fehlberg (1911-1990) was born in Germany, received his doctorate from the Technical University 
of Berlin in 1942, emigrated to the United States after World War II, and was employed by NASA for 
many years. The Runge-Kutta-Fehlberg method was first published in a NASA Technical Report in 1969. 

6 The details of the RKF method may be found, for example, in the books by Ascher and Petzold and by 
Mattheij and Molenaar that are listed in the references. 
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4fl 7. / = 0.5 — Z + 2y, y(0) = l fl 8.y' = 5t-3Jy, y( 0) = 2 

4fl 9. y = JTTy, yd 0) = 3 10. y = 2t + <r* y(0) = 1 

4fl 11. / = (4 - ty)/( 1 +/), >-(0) = -2 

#2, 12. y' = (y 2 + 200/(3 + z 2 ), y(0) = 0.5 

13. Confirm the results in Table 8.3.1 by executing the indicated computations. 

14. Consider the initial value problem 

y' = t 2 +y 2 , y(0) = 1. 

(a) Draw a direction field for this equation. 

(b) Use the Runge-Kutta method or another method to find approximate values of the 
solution at t = 0.8,0.9, and 0.95. Choose a small enough step size so that you believe your 
results are accurate to at least four digits. 

(c) Try to extend the calculations in part (b) to obtain an accurate approximation to the 
solution at t = 1. If you encounter difficulties in doing this, explain why you think this 
happens. The direction field in part (a) may be helpful. 

15. Consider the initial value problem 

y' = 3t l /(3y 2 -4), y(0) = 0. 

(a) Draw a direction field for this equation. 

(b) Estimate how far the solution can be extended to the right. Let t M be the right endpoint 
of the interval of existence of this solution. What happens at tM to prevent the solution 
from continuing farther? 

(c) Use the Runge-Kutta method with various step sizes to determine an approximate 
value of t M - 

(d) If you continue the computation beyond tM, you can continue to generate values of y. 
What significance, if any, do these values have? 

(e) Suppose that the initial condition is changed to y(0) = 1. Repeat parts (b) and (c) for 
this problem. 


8.4 Multistep Methods 


In previous sections we have discussed numerical procedures for approximating the 
solution of the initial value problem 

y'=f(t,y), y(to)=yo, (l) 

in which data at the point t = t n are used to calculate an approximate value of the 
solution (j){t n+ 1 ) at the next mesh point t = t n+ \. In other words, the calculated value 
of 0 at any mesh point depends only on the data at the preceding mesh point. Such 
methods are called one-step methods. However, once approximate values of the 
solution y = 0(0 have been obtained at a few points beyond to, it is natural to ask 
whether we can make use of some of this information, rather than just the value at 
the last point, to calculate the value of 0(0 at the next point. Specifically, if y\ at t \, 
y 2 at t 2 ,...,y n at t n are known, how can we use this information to determine y n+ 1 at 
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t n+ \ ? Methods that use information at more than the last mesh point are referred to 
as multistep methods. In this section we will describe two types of multistep methods: 
Adams 7 methods and backward differentiation methods. Within each type, we can 
achieve various levels of accuracy, depending on the number of preceding data points 
that are used. For simplicity, we will assume throughout our discussion that the step 
size h is constant. 


Adams Methods. Recall that 

/ tn+l 

<t>\t)dt, (2) 

where 0(t) is the solution of the initial value problem (1). The basic idea of an Adams 
method is to approximate <// ft) by a polynomial Pkft) of degree k and to use the 
polynomial to evaluate the integral on the right side of Eq. (2). The coefficients in 
Pkit) are determined by using k + 1 previously calculated data points. For example, 
suppose that we wish to use a first degree polynomial P\(t) = At + B. Then we need 
only the two data points (t n ,y n ) and (t n -uy n -i). For Pi to be an approximation to 
0', we require that P\(t n ) = f(t n ,y n ) and that Pi(t n -i) = f(t n -i,y n -i). Recall that we 
denote f{tj,yf) by f for an integer j. Then A and B must satisfy the equations 


At n + B — f n , 

( 3 ) 

At n — i T B = f n — 1- 

Solving for A and B , we obtain 

A fn — fn -1 D fn-An ~~ fn^n-l , 

Replacing cj)'(t) by P\{t) and evaluating the integral in Eq. (2), we find that 

0(^«+l) — 0(^«) — — t n ) + B(t n +1 — tn)- 

Finally, we replace <f>(t n+ {) and (p(t n ) by y n+ 1 and y n , respectively, and carry out some 
algebraic simplification. For a constant step size h, we obtain 

y n + 1 = y n + I hfn - \hf n -i_. (5) 

Equation (5) is the second order Adams-Bashforth 8 formula. It is an explicit formula 
for y n+ 1 in terms of y n and y n -\ and has a local truncation error proportional to h 3 . 

We note in passing that the first order Adams-Bashforth formula, based on the 
polynomial Po(t) = f n of degree zero, is just the original Euler formula. 


7 John Couch Adams (1819-1892), an English mathematician and astronomer, is most famous as codiscov¬ 
erer, with Joseph Leverrier, of the planet Neptune in 1846. He was associated with Cambridge University 
for most of his life, as student (1839-1843), fellow, Lowdean Professor, and director of the Observa¬ 
tory. Adams was extremely skilled at computation; his procedure for numerical integration of differential 
equations appeared in 1883 in a book with Francis Bashforth on capillary action. 

8 Francis Bashforth (1819-1912), English mathematician and Anglican priest, was a classmate of J. C. 
Adams at Cambridge. He was particularly interested in ballistics and invented the Bashforth chronograph 
for measuring the velocity of artillery projectiles. 
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More accurate Adams formulas can be obtained by following the procedure out¬ 
lined above, but using a higher degree polynomial and correspondingly more data 
points. For example, suppose that a polynomial P 3 (t) of degree three is used. The 
coefficients are determined from the four points (t n ,y n ), (t„_i,y n _i), ( t n _ 2 ,yn- 2 ), and 
(t n - 3 ,y n - 3 ). Substituting this polynomial for 4>'(t) in Eq. (2), evaluating the integral, 
and simplifying the result, we eventually obtain the fourth order Adams-Bashforth 
formula 

y n + 1 = y n + (A/24)(55/ w - 59/rc-i + 37/„_2 - 9/„_ 3 ). (6) 

The local truncation error of this fourth order formula is proportional to h 5 . 

A variation on the derivation of the Adams-Bashforth formulas gives another set 
of formulas called the Adams-Moulton 9 formulas. To see the difference, let us again 
consider the second order case. Again we use a first degree polynomial Q\ it) = at + /3, 
but we determine the coefficients by using the points (t n ,y n ) and fe+i,y n+ i)* Thus a 
and ft must satisfy 


and it follows that 


at n + ft — /«, 

Wtn+1 + P = fn+ 1 ? 


fn +1 ~fn 



P = 


fn.tn+1 fn+ltn 

h 


Substituting Q\(t) for <fi\t) in Eq. (2) and simplifying, we obtain 


(7) 

( 8 ) 


yn +1 — yn T 2 hf n 3” 3^+l)’ 


(9) 


which is the second order Adams-Moulton formula. We have written /(£ w +i,y w +i) 
in the last term to emphasize that the Adams-Moulton formula is implicit, rather 
than explicit, since the unknown y n+1 appears on both sides of the equation. The 
local truncation error for the second order Adams-Moulton formula is proportional 
to h\ 

The first order Adams-Moulton formula is just the backward Euler formula, as 
you might anticipate by analogy with the first order Adams-Bashforth formula. 

More accurate higher order formulas can be obtained by using an approximating 
polynomial of higher degree. The fourth order Adams-Moulton formula, with a local 
truncation error proportional to h 5 , is 

)Wl = yn + (h/24)(9f n +i + 19 fn - 5/„_i +/*-2). (10) 

Observe that this is also an implicit formula, because y n+ 1 appears mf n+ \. 

Although both the Adams-Bashforth and Adams-Moulton formulas of the same 
order have local truncation errors proportional to the same power of h, the Adams- 
Moulton formulas of moderate order are in fact considerably more accurate. 
For example, for the fourth order formulas (6) and (10), the proportionality constant 


9 Forest Ray Moulton (1872-1952), an American astronomer and administrator of science, was for many 
years professor of astronomy at the University of Chicago. During World War I, he was in charge of 
the Ballistics Branch of the U.S. Army at Aberdeen (MD) Proving Ground. In the course of calculating 
ballistics trajectories he devised substantial improvements in the Adams formula. 






8.4 Multistep Methods 


475 


for the Adams-Moulton formula is less than 1/10 of the proportionality constant 
for the Adams-Bashforth formula. Thus the question arises: is it better to use the 
explicit (and faster) Adams-Bashforth formula or the more accurate but implicit 
(and slower) Adams-Moulton formula? The answer depends on whether, by using 
the more accurate formula, you can increase the step size, and thereby reduce the 
number of steps enough to compensate for the additional computations required at 
each step. 

In fact, numerical analysts have attempted to achieve both simplicity and accuracy 
by combining the two formulas in what is called a predictor-corrector method. Once 
y n - 3, y n - 2 , y n -u and y n are known, we can compute f n -3,fn-2,fn-i, and and then 
use the Adams-Bashforth (predictor) formula (6) to obtain a first value for y n +i- 
Then we compute f n+ \ and use the Adams-Moulton (corrector) formula (10), which 
is no longer implicit, to obtain an improved value of y n+ \. We can, of course, continue 
to use the corrector formula (10) if the change in y n+ \ is too large. However, if it is 
necessary to use the corrector formula more than once or perhaps twice, it means 
that the step size h is too large and should be reduced. 

In order to use any of the multistep methods, it is necessary first to calculate a few 
yj by some other method. For example, the fourth order Adams-Moulton method 
requires values for y\ and y 2 , while the fourth order Adams-Bashforth method also 
requires a value for y 3 . One way to proceed is to use a one-step method of comparable 
accuracy to calculate the necessary starting values. Thus, for a fourth order multistep 
method, we might use the fourth order Runge-Kutta method to calculate the starting 
values. This is the method used in the next example. 

Another approach is to use a low order method with a very small h to calculate yi, 
and then to increase gradually both the order and the step size until enough starting 
values have been determined. 


EXAMPLE 

1 


Consider again the initial value problem 

y' = \ - t + 4y, v(0) = 1. 


( 11 ) 


With a step size of h = 0.1, determine an approximate value of the solution y = 0(7) at t = 0.4 
using the fourth order Adams-Bashforth formula, the fourth order Adams-Moulton formula, 
and the predictor-corrector method. 

For starting data, we use the values of yi,y 2 , and y 3 found by the Runge-Kutta method. 
These are tabulated in Table 8.3.1. Next, calculating the corresponding values of fit,y), we 
obtain 

yo = 1, fo = 5, 

yi = 1.6089333, fi = 7.3357332, 

y 2 = 2.5050062, f 2 = 10.820025, 


y 3 = 3.8294145, f 3 = 16.017658. 


Then, from the Adams-Bashforth formula, Eq. (6), we find that y 4 = 5.7836305. The exact 
value of the solution at t = 0.4, correct through eight digits, is 5.7942260, so the error is 
-0.0105955. 

The Adams-Moulton formula, Eq. (10), leads to the equation 


y 4 = 4.9251275 + 0.15y 4 , 


from which it follows that y 4 = 5.7942676 with an error of only 0.0000416. 
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Finally, using the result from the Adams-Bashforth formula as a predicted value of 0(0.4), 
we can then use Eq. (10) as a corrector. Corresponding to the predicted value of y 4 , we find 
that/ 4 = 23.734522. Hence, from Eq. (10), the corrected value of y 4 is 5.7926721. This result is 
in error by -0.0015539. 

Observe that the Adams-Bashforth method is the simplest and fastest of these methods, 
since it involves only the evaluation of a single explicit formula. It is also the least accurate. 
Using the Adams-Moulton formula as a corrector increases the amount of calculation that 
is required, but the method is still explicit. In this problem the error in the corrected value 
of y 4 is reduced by approximately a factor of 7 when compared to the error in the predicted 
value. The Adams-Moulton method alone yields by far the best result, with an error that is 
about 1/40 as large as the error from the predictor-corrector method. Remember, however, 
that the Adams-Moulton method is implicit, which means that an equation must be solved 
at each step. In the problem considered here this equation is linear, so the solution is quickly 
found, but in other problems this part of the procedure may be much more time-consuming. 

The Runge-Kutta method with h = 0.1 gives y 4 = 5.7927853 with an error of —0.0014407; 
see Table 8.3.1. Thus, for this problem, the Runge-Kutta method is comparable in accuracy to 
the predictor-corrector method. 


Backward Differentiation Formulas. Another type of multistep method uses a polynomial 
Pk(t ) to approximate the solution 0(0 of the initial value problem (1) rather than 
its derivative 0'(r), as in the Adams methods. We then differentiate Pk(t) and set 
P' k (t n + 1 ) equal to f(t n +i,y n+ {) to obtain an implicit formula for y n +\. These are called 
backward differentiation formulas. These methods became widely used in the 1970s 
because of the work of C. William Gear 10 on so-called stiff differential equations, 
whose solutions are very difficult to approximate by the methods discussed up to 
now; see Section 8.6. 

The simplest case uses a first degree polynomial P\(t) = At + B. The coefficients 
are chosen to match the computed values of the solution y n and y n +i- Thus A and B 
must satisfy 


At n + B — y n , 
At n +\ T B — y n+ i . 

Since P[(t) = A , the requirement that 

P\(tn+l) = /ftrc+lj y n +l) 


( 12 ) 


is just 


A —f (tn+hyn+l) • 


(13) 


Another expression for A comes from subtracting the first of Eqs. (12) from the 
second, which gives 

A = (y„+1 - y n )/h. 


10 C. William Gear (1935-), born in London, England, received his undergraduate education at Cambridge 
University and his doctorate in 1960 from the University of Illinois. He was a member of the faculty at the 
University of Illinois for most of his career and made significant contributions to both computer design 
and numerical analysis. His influential book on numerical methods for differential equations is listed in 
the references. 
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EXAMPLE 

2 


Substituting this value of A into Eq. (13) and rearranging terms, we obtain the first 
order backward differentiation formula 

y n + 1 = y n + hf(t n+1 ,y n +i). (14) 

Note that Eq. (14) is just the backward Euler formula that we first saw in Section 8.1. 

By using higher order polynomials and correspondingly more data points, we can 
obtain backward differentiation formulas of any order. The second order formula is 

y n + 1 = 5 [4 y n ~ y n -i + 2hf(t n+1 ,y n+1 )\ , (15) 

and the fourth order formula is 

y n + 1 = ^[48 y n - 36y n ~i + 16 y n -2 - 3y n -3 + 12hf(t n+ i,y n+ i)] . (16) 

These formulas have local truncation errors proportional to h 3 and h 5 , respectively. 


Use the fourth order backward differentiation formula with h = 0.1 and the data given in 
Example 1 to determine an approximate value of the solution y = <p(t) at t = 0.4 for the initial 
value problem (11). 

Using Eq. (16) with n = 3, h = 0.1, and with y 0 ,... ,y 3 given in Example 1, we obtain the 
equation 

y 4 = 4.6837842 + 0.192y 4 . 


Thus 


y 4 = 5.7967626. 


Comparing the calculated value with the exact value 0(0.4) = 5.7942260, we find that the error 
is 0.0025366. This is somewhat better than the result using the Adams-Bashforth method, but 
it is not as good as the result using the predictor-corrector method, and not nearly as good as 
the result using the Adams-Moulton method. 


A comparison between one-step and multistep methods must take several factors 
into consideration. The fourth order Runge-Kutta method requires four evaluations 
of / at each step, while the fourth order Adams-Bashforth method (once past the 
starting values) requires only one, and the predictor-corrector method only two. 
Thus, for a given step size h, the latter two methods may well be considerably faster 
than Runge-Kutta. However, if Runge-Kutta is more accurate and therefore can use 
fewer steps, then the difference in speed will be reduced and perhaps eliminated. The 
Adams-Moulton and backward differentiation formulas also require that the diffi¬ 
culty in solving the implicit equation at each step be taken into account. All multistep 
methods have the possible disadvantage that errors in earlier steps can feed back into 
later calculations with unfavorable consequences. On the other hand, the underly¬ 
ing polynomial approximations in multistep methods make it easy to approximate 
the solution at points between the mesh points, should this be desirable. Multistep 
methods have become popular largely because it is relatively easy to estimate the 
error at each step and to adjust the order or the step size to control it. For a further 
discussion of such questions as these, see the books listed at the end of this chapter; 
in particular, Shampine (1994) is an authoritative source. 
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PROBLEMS In each of Problems 1 through 6, determine an approximate value of the solution at t = 0.4 
and t = 0.5 using the specified method. For starting values, use the values given by the Runge- 
Kutta method; see Problems 1 through 6 of Section 8.3. Compare the results of the various 
methods with each other and with the actual solution (if available). 

(a) Use the fourth order predictor-corrector method with h = 0.1. Use the corrector formula 
once at each step. 

(b) Use the fourth order Adams-Moulton method with h = 0.1. 

(c) Use the fourth order backward differentiation method with h = 0.1. 


4fl 

i. / 

II 

+ 

1 

y( 0) = l 

41 

2. y = 5t - 3 Jy, 

y(0) = 2 


3- / 

rn 

1 

& 

ii 

y(0) = l 

41 

-J^ 

x. 

II 

to 

+ 

1 

y(0) = l 

41 

5. / 

y 1 + 2 ty 

3 + t 2 ’ 

y(0) = 0.5 

41 

6. y = ( t 2 — y 1 ) siny, 

y(0) = -l 


In each of Problems 7 through 12, find approximate values of the solution of the given initial 
value problem at t = 0.5, 1.0, 1.5, and 2.0, using the specified method. For starting values, 
use the values given by the Runge-Kutta method; see Problems 7 through 12 in Section 8.3. 
Compare the results of the various methods with each other and with the actual solution (if 
available). 

(a) Use the fourth order predictor-corrector method with h = 0.05. Use the corrector formula 
once at each step. 

(b) Use the fourth order Adams-Moulton method with h = 0.05. 

(c) Use the fourth order backward differentiation method with h = 0.05. 

4fl 7. / = 0.5 - t + 2y, y(0) = 1 8. / = 5t - 3 Jy, y( 0) = 2 

4fl 9. y = ^T+y, y(0) = 3 10. / = 21 + e"* y(0) = 1 

4fl 11. / = (4 - 00/(1 +/), >-(0) = -2 

4fl 12- / = (y 2 + 200/(3 + t 2 ), >-(0) = 0.5 

13. Show that the first order Adams-Bashforth method is the Euler method and that the first 
order Adams-Moulton method is the backward Euler method. 


14. Show that the third order Adams-Bashforth formula is 


y n + 1 =y, I + (/i/12)(23/„ - 16/„_i + 5/„_ 2 ). 


15. Show that the third order Adams-Moulton formula is 

y n +1 =y n + (h/l2)(5f n+1 + 8f„ i). 

16. Derive the second order backward differentiation formula given by Eq. (15) in this section. 


8.5 Systems of First Order Equations 


In the preceding sections we discussed numerical methods for approximating the 
solution of an initial value problem associated with a first order differential equation. 
These methods can also be applied to a system of first order equations. Since a 
higher order equation can always be reduced to a system of first order equations, 
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it is sufficient to deal with systems of first order equations alone. For simplicity, we 
consider a system of two first order equations 


x' =f(t,x,y), 

with the initial conditions 

y' = g(t,x,y). 

(1) 

II 

X 

o 

II 

o 

(2) 


The functions / and g are assumed to satisfy the conditions of Theorem 7.1.1 so that 
the initial value problem (1), (2) has a unique solution in some interval of the t-axis 
containing the point to- We wish to determine approximate values X\,X 2 ,... ,x n ,... 
and yi,y 2 , • • • ,y w ,... of the solution x = (/>(t),y = \[r(t) at the points t n = to + nh with 
n = 1 , 2 ,.... 

In vector notation, the initial value problem (1), (2) can be written as 

x' = f(f,x), x(f 0 )=xo, (3) 

where x is the vector with components % and y, f is the vector function with com¬ 
ponents / and g, and xq is the vector with components xo and yo- The methods of 
the previous sections can be readily generalized to handle systems of two (or more) 
equations. All that is needed (formally) is to replace the scalar variable x by the vec¬ 
tor x and the scalar function / by the vector function f in the appropriate equations. 
For example, the Euler formula becomes 

X „+1 = x„ + ht n , (4) 

or, in component form, 

[%n+1\ _ (%n\ , i ff (tn?Xn?yn)\ /r\ 

VW “ W \g(tn,Xn,yn)J ' K ' 

The initial conditions are used to determine f o, which is the vector tangent to the graph 
of the solution x = 0(t) at the initial point xo in the xy-plane. We move in the direc¬ 
tion of this tangent vector for a time step h in order to find the next point xi. Then 
we calculate a new tangent vector fi at xi, move along it for a time step h to find X 2 , 
and so forth. 

In a similar way, the Runge-Kutta method can be extended to a system. For the 
step from t n to t n+ \ we have 

^n +1 = T k n \ T 2k^2 T 2k^3 + k W 4), (6) 

where 


k«i — f (t n , x n ), 

K 2 = f [tn + (h/2),X n + (h/ 2)k„i], 

( 7 ) 

K3 = f [tn + (h/2),x n + (h/ 2)k w2 ], 

K 4 = f(t n +h,x n +hk n3 ). 

The formulas for the Adams-Moulton predictor-corrector method as it applies to 
the initial value problem (1), (2) are given in Problem 9. 

The vector equations (3), (4), (6), and (7) are, in fact, valid in any number of 
dimensions. All that is needed is to interpret the vectors as having n components 
rather than two. 
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EXAMPLE 

1 


Determine approximate values of the solution x = 0(0, y = 0(0 of the initial value problem 

x! = x - 4 y, y' = -x + y, (8) 

x(0) = 1, y( 0) = 0, (9) 


at the point t = 0.2. Use the Euler method with h = 0.1 and the Runge-Kutta method with 
h = 0.2. Compare the results with the values of the exact solution: 


0(0 = 


+ e s ‘ 


0(0 = 


( 10 ) 


2 4 

Let us first use the Euler method. For this problem, f n = x n — 4 y n and g n = —x n + y n \ hence 

fo = 1 - (4) (0) = 1, go = -1 + 0 = -1. 

Then, from the Euler formulas (4) and (5), we obtain 


X! = 1 + (0.1)(1) = 1.1, y i=0 + (0.1)(-1) = -0.1. 

At the next step, 

fi = 1.1 - (4)(—0.1) = 1.5, gl = -1.1 + (-0.1) = -1.2. 

Consequently, 

x 2 = 1.1 + (0.1)(1.5) = 1.25, y 2 = -0.1 + (0.1)(—1.2) = -0.22. 


The values of the exact solution, correct to eight digits, are 0(0.2) = 1.3204248 and 
0(0.2) = —0.25084701. Thus the values calculated from the Euler method are in error by 
about 0.0704 and 0.0308, respectively, corresponding to percentage errors of about 5.3% and 
12.3%. 

Now let us use the Runge-Kutta method to approximate 0(0.2) and 0(0.2). With h = 0.2 
we obtain the following values from Eqs. (7): 


koi = 


7d,o)\ 

K ga,o)) 



ko2 


7a.i,-o.i)\ 
71.1, -0.1)/ 



7(1-15, -0.12)\ _ / 1.63\ 
^(1.15,-0.12)/ " y—1.27/ ’ 


/ 2.342\ 
y—1.580/ 

Then, substituting these values in Eq. (6), we obtain 

_ /1\ 02 / 9.602\ _ / 1.3200667 \ 

Xl “V 0 / 6 y-7.52 / “ y—0.25066667/ ' 


7(1.326,-0.254)\ 
^(1.326,-0.254)/ 


These values of x\ and y\ are in error by about 0.000358 and 0.000180, respectively, with 
percentage errors much less than one-tenth of 1%. 

This example again illustrates the great gains in accuracy that are obtainable by using a more 
accurate approximation method, such as the Runge-Kutta method. In the calculations we have 
just outlined, the Runge-Kutta method requires only twice as many function evaluations as 
the Euler method, but the error in the Runge-Kutta method is about 200 times less than that 
in the Euler method. 
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PROBLEMS In each of Problems 1 through 6 , determine approximate values of the solution x = 0(0, 
y = 0(0 of the given initial value problem at t = 0.2,0.4,0.6,0.8, and 1.0. Compare the results 
obtained by different methods and different step sizes. 

(a) Use the Euler method with h — 0.1. 

(b) Use the Runge-Kutta method with h = 0.2. 

(c) Use the Runge-Kutta method with h = 0.1. 

1 . x' = x + y + t, y = 4x - 2y; x(0) = 1, y (0) = 0 

2 . x' = 2x + ty, y = xy; x( 0 ) = 1 , y( 0 ) = 1 

^ 2 / 3. x' = —tx — y — 1 , y = x; x( 0 ) = 1 , y( 0 ) = 1 

4. x! = x - y + xy, y' = 3x-2y- xy; x(0) = 0, y(0) = 1 

5. x' = x(l — 0.5x - 0.5y), y' = y(-0.25 + 0.5x); x(0) = 4, y(0) = 1 

^2/ 6 . x' = exp(—x + y) — cosx, y' = sin(x — 3y); x(0) = 1, y(0) = 2 

7. Consider the example problem x' = x — 4y, y' = — x + y with the initial conditions 
x(0) = 1 and y(0) = 0. Use the Runge-Kutta method to find approximate values of 
the solution of this problem on the interval 0 < t < 1. Start with h = 0.2, and then 
repeat the calculation with step sizes h = 0.1,0.05,..., each half as long as in the preceding 
case. Continue the process until the first five digits of the solution at t = 1 are unchanged 
for successive step sizes. Determine whether these digits are accurate by comparing them 
with the exact solution given in Eqs. (10) in the text. 

8 . Consider the initial value problem 

x" + t 2 x' + 3 x = t, x(0) = 1, x ; (0) = 2. 

Convert this problem to a system of two first order equations, and determine approximate 
values of the solution at t = 0.5 and t = 1.0 using the Runge-Kutta method with h = 0.1. 

9. Consider the initial value problem x' = f(t,x,y) and / = g(t,x,y) with x(t 0 ) = x 0 and 
y(t 0 ) = yo. The generalization of the Adams-Moulton predictor-corrector method of 
Section 8.4 is 


x n +i =x n + ^h(55f„ - 59/„_i + 37/„_ 2 - 9/„_ 3 ), 
y n + 1 =y n + £h(55g n - 59g„_! + 37g„_2 - 9g„_ 3 ) 

and 

Xn+l = Xn + ^^(9/n+l + 19/ n — 5/ n _i + fn- 2)5 

yn +1 — yn T 24^(9g n+ i + 19 g n ~ $8n -1 T gn-2)- 

Determine an approximate value of the solution at t = 0.4 for the example initial value 
problem x' = x — 4y, y' = — x + y with x(0) = 1, y(0) = 0. Take h = 0.1. Correct the pre¬ 
dicted value once. For the values of xi,... ,y$ use the values of the exact solution rounded 
to six digits:xi = 1.12735, x 2 = 1.32042, x 3 = 1.60021, yi = -0.111255, y 2 = -0.250847, 
andy 3 — —0.429696. 
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8.6 More on Errors; Stability 


In Section 8.1 we discussed some ideas related to the errors that can occur in a 
numerical approximation of the solution of the initial value problem 

y'=f(t,y), y(to)=yo- (l) 

In this section we continue that discussion and also point out some other difficulties 
that can arise. Some of the points that we wish to make are fairly difficult to treat in 
detail, so we will illustrate them by means of examples. 

Truncation and Round-off Errors. Recall that for the Euler method we showed that the 
local truncation error is proportional to h 2 and that for a finite interval, the global trun¬ 
cation error is at most a constant times h. In general, for a method of order p , the local 
truncation error is proportional to h p+1 and the global truncation error on a finite 
interval is bounded by a constant times h p .To achieve high accuracy, we normally use 
a numerical procedure for which p is fairly large, perhaps 4 or higher. As p increases, 
the formula used in computing y n+ i normally becomes more complicated, and hence 
more calculations are required at each step. However, this is usually not a serious 
problem unless f(t,y) is very complicated or the calculation must be repeated very 
many times. If the step size h is decreased, the global truncation error is decreased by 
the same factor raised to the power p. However, as we mentioned in Section 8.1, if /z is 
very small, a great many steps will be required to cover a fixed interval, and the global 
round-off error may be larger than the global truncation error. The situation is shown 
schematically in Figure 8.6.1. We assume that the round-off error R n is proportional 
to the number of computations performed and therefore is inversely proportional to 
the step size h. On the other hand, the truncation error E n is proportional to a positive 
power of h. From Eq. (17) of Section 8.1, we know that the total error is bounded by 
\E n \ + \R n \; hence we wish to choose h so as to minimize this quantity. The optimum 
value of h occurs when the rate of increase of the truncation error (as h increases) is 
balanced by the rate of decrease of the round-off error, as indicated in Figure 8.6.1. 



FIGURE 8.6.1 The dependence of truncation and round-off errors on the step size h. 


EXAMPLE 

1 


Consider the example problem 


y = l-t + 4y, y(0) = 1. (2) 

Using the Euler method with various step sizes, calculate approximate values for the solution 
0(0 at t = 0.5 and t = 1. Try to determine the optimum step size. 







8.6 More on Errors; Stability 


483 


Keeping only four digits in order to shorten the calculations, we obtain the data shown in 
Table 8.6.1. The first two columns are the step size h and the number of steps N required to 
traverse the interval 0 < t < 1. Then y N/2 and y # are approximations to 0(0.5) = 8.712 and 
0(1) = 64.90, respectively. These quantities appear in the third and fifth columns. The fourth 
and sixth columns display the differences between the calculated values and the actual value 
of the solution. 


TABLE 8.6.1 Approximations to the Solution of the Initial Value 
Problem y' = 1 — t + 4y, y(0) = 1 Using the Euler Method with 
Different Step Sizes 


h 

N 

yN/2 

Error 

yN 

Error 

0.01 

100 

8.390 

0.322 

60.12 

4.78 

0.005 

200 

8.551 

0.161 

62.51 

2.39 

0.002 

500 

8.633 

0.079 

63.75 

1.15 

0.001 

1000 

8.656 

0.056 

63.94 

0.96 

0.0008 

1250 

8.636 

0.076 

63.78 

1.12 

0.000625 

1600 

8.616 

0.096 

64.35 

0.55 

0.0005 

2000 

8.772 

0.060 

64.00 

0.90 

0.0004 

2500 

8.507 

0.205 

63.40 

1.50 

0.00025 

4000 

8.231 

0.481 

56.77 

8.13 


For relatively large step sizes, the round-off error is much less than the global truncation 
error. Consequently, the total error is approximately the same as the global truncation error, 
which for the Euler method is bounded by a constant times h. Thus, as the step size is reduced, 
the error is reduced proportionally. The first three lines in Table 8.6.1 show this type of behavior. 
For h = 0.001 the error has been further reduced, but much less than proportionally; this 
indicates that round-off error is becoming important. As h is reduced still more, the error 
begins to fluctuate, and further improvements in accuracy become problematical. For values 
of h less than 0.0005, the error is clearly increasing, which indicates that round-off error is 
now the dominant part of the total error. 

These results can also be expressed in terms of the number of steps N. For N less than 
about 1000, accuracy is improved by taking more steps, while for N greater than about 2000, 
using more steps has an adverse effect. Thus for this problem it is best to use an N somewhere 
between 1000 and 2000. For the calculations shown in Table 8.6.1, the best result at t = 0.5 
occurs for N = 1000, while at t = 1.0 the best result is for N = 1600. 


You should be careful not to read too much into the results shown in Example 1. 
The optimum ranges for h and N depend on the differential equation, the numerical 
method that is used, and the number of digits that are retained in the calculation. 
Nevertheless, it is generally true that if too many steps are required in a calculation, 
then eventually round-off error is likely to accumulate to the point where it seriously 
degrades the accuracy of the procedure. For many problems this is not a concern: 
for them, any of the fourth order methods we have discussed in Sections 8.3 and 8.4 
will produce good results with a number of steps far less than the level at which 
round-off error becomes important. For some problems, however, round-off error 
does become vitally important. For such problems, the choice of method may be 
crucial. This is also one reason why modern codes provide a means of adjusting 
the step size as they go along, using a larger step size wherever possible and a very 
small step size only where necessary. 
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Vertical Asymptotes. As a second example, consider the problem of approximating the 
solution^ = 0(0 of 

y' = t 2 +y 2 , y(0) = l. (3) 

Since the differential equation is nonlinear, the existence and uniqueness theorem 
(Theorem 2.4.2) guarantees only that there is a solution in some interval about t = 0. 
Suppose that we try to compute an approximation to the solution of the initial value 
problem on the interval 0 < t < 1 using different numerical procedures. 

If we use the Euler method with h = 0.1, 0.05, and 0.01, we find the follow¬ 
ing approximate values at t = 1: 7.189548,12.32093, and 90.75551, respectively. The 
large differences among the computed values are convincing evidence that we should 
use a more accurate numerical procedure—the Runge-Kutta method, for exam¬ 
ple. Using the Runge-Kutta method with h = 0.1, we find the approximate value 
735.0991 at t = 1, which is quite different from those obtained using the Euler method. 
Repeating the calculations using step sizes of h = 0.05 and h = 0.01, we obtain the 
information shown in Table 8.6.2. 


TABLE 8.6.2 Approximations to the Solution 
of the Initial Value Problem y' = t 2 + y 2 , 
y(0) = 1 Using the Runge-Kutta Method 


h 

t = 0.90 

f = 1.0 

0.1 

14.02182 

735.0991 

0.05 

14.27117 

1.75863 x 10 s 

0.01 

14.30478 

2.0913 x 10 2893 

0.001 

14.30486 



The values at t = 0.90 are reasonable, and we might well believe that the solution 
has a value of about 14.305 at t = 0.90. However, it is not clear what is happen¬ 
ing between t = 0.9 and t = 1.0. To help clarify this, let us turn to some analytical 
approximations to the solution of the initial value problem (3). Note that on 0 < t < 1, 

y 2 <t 2 +y 2 < 1 +y 2 . (4) 

This suggests that the solution y = 0i (t) of 

y' = l+y 2 , y(0) = 1 (5) 

and the solution y = 02(0 of 

/ = /, y(0) =1 (6) 

are upper and lower bounds, respectively, for the solution y = 0(0 of the original 
problem, since all these solutions pass through the same initial point. Indeed, it can be 
shown (for example, by the iteration method of Section 2.8) that 02(0 < 0(0 < 0i(O 
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as long as these functions exist. The important thing to note is that we can solve 
Eqs. (5) and (6) for 0 1 and 02 by separation of variables. We find that 

0i(O = tan(? + 0 , 02(0 = j-E. (7) 

Thus 02(0 -> oo as t -> 1, and 0i(O -> oo as t -> 7t/ 4 = 0.785. These calculations 
show that the solution of the original initial value problem exists at least for 
0 < t < 7r/4 and at most for 0 < t < 1. The solution of the problem (3) has a vertical 
asymptote for some t in 7 t/4 <t< 1 and thus does not exist on the entire interval 
0<f <1. 

Our numerical calculations, however, suggest that we can go beyond t = n/4, and 
probably beyond t = 0.9. Assuming that the solution of the initial value problem 
exists at t = 0.9 and has the value 14.305, we can obtain a more accurate estimate of 
what happens for larger t by considering the initial value problems (5) and (6) with 
y(0) = 1 replaced by y(0.9) = 14.305. Then we obtain 

0i(0 = tan(t + 0.60100), 0 2 (O = 1/(0.96991 - t), (8) 

where five decimal places have been kept in the calculation. Therefore, 0 1 ( t) -> oo as 
t -> 7t/ 2 - 0.60100 = 0.96980 and 02 (t) -> oo as t -> 0.96991. We conclude that the 
asymptote of the solution of the initial value problem (3) lies between these two 
values. This example illustrates the sort of information that can be obtained by a 
judicious combination of analytical and numerical work. 

Stability. The concept of stability is associated with the possibility that small errors 
that are introduced in the course of a mathematical procedure may die out as the 
procedure continues. Conversely, instability occurs if small errors tend to increase, 
perhaps without bound. For example, in Section 2.5 we identified equilibrium solu¬ 
tions of a differential equation as (asymptotically) stable or unstable, depending on 
whether solutions that were initially near the equilibrium solution tended to approach 
it or to depart from it as t increased. Somewhat more generally, the solution of an 
initial value problem is asymptotically stable if initially nearby solutions tend to 
approach the given solution, and unstable if they tend to depart from it. Visually, in 
an asymptotically stable problem the graphs of solutions will come together, while 
in an unstable problem they will separate. 

If we are investigating an initial value problem numerically, the best that we can 
hope for is that the numerical approximation will mimic the behavior of the actual 
solution. We cannot make an unstable problem into a stable one merely by approx¬ 
imating its solution numerically. However, it may well happen that a numerical 
procedure will introduce instabilities that were not part of the original problem, and 
this can cause trouble in approximating the solution. Avoidance of such instabilities 
may require us to place restrictions on the step size h. 

To illustrate what can happen in the simplest possible context, consider the 
differential equation 

dy/dt = ry , (9) 

where r is a constant. Suppose that in approximating the solution of this equation, 
we have reached the point (t n ,y n ). Let us compare the exact solution of Eq. (9) that 
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passes through this point, namely, 

y — y n exp[r(t - t n )l (10) 

with numerical approximations obtained from the Euler formula 

y n + 1 = y n + hf(t n ,y n ) (li) 

and from the backward Euler formula 

y n +1 = y n + hf(t n +uy n +i). (12) 

From the Euler formula (11) we obtain 

y n + 1 = y n + hry n =y n ( 1 + r/z). (13) 

Similarly, from the backward Euler formula (12) we have 

y n + 1 = + /zry„+i, 


or 

y n + 1 = = y w [l + rh + (r/z) 2 H-]. 

1 — rh 


Finally, evaluating the solution (10) at t n + h, we find that 


y n +1 = y* exp (r/z) = 


1 + r/z + 


(r/z) 2 

2 



(14) 


(15) 


Comparing Eqs. (13), (14), and (15), we see that the errors in both the Euler formula 
and the backward Euler formula are of order /z 2 , as the theory predicts. 

Now suppose that we change the value y n to y n + 8. Think, if you wish, of 8 as the 
error that has accumulated by the time we reach t = t n . The question is whether this 
error increases or decreases in going one more step to t n+ \. 

For the exact solution (15), the change in y n+ 1 due to the change 8 in y n is just 
8 exp (rh). This quantity is less than 8 if exp (rh) < 1, or in other words if r < 0. This 
confirms our conclusion in Chapter 2 that Eq. (9) is asymptotically stable if r < 0, 
and is unstable if r > 0. 

For the backward Euler method, the change in y n+ \ inEq. (14) due to 8 is 5/(1 — rh). 
For r < 0 the quantity 1/(1 — rh) is always nonnegative and less than 1. Thus, if the 
differential equation is stable, then so is the backward Euler method for an arbitrary 
step size h. 

On the other hand, for the Euler method, the change in y n+ 1 in Eq. (13) due to 
8 is 5(1 + rh). For r < 0 we can write 1 + rh as 1 — \r\h. Then the requirement that 
\l + rh\ < 1 is equivalent to 


—1 < 1 — \r\h <1, or 0 < \r\h < 2. 


Consequently, h must satisfy h <2/\r\. Thus the Euler method is not stable for this 
problem unless h is sufficiently small. 

The restriction on the step size h in using the Euler method in the preceding 
example is rather mild unless \r\ is quite large. Nonetheless, the example illustrates 
that it may be necessary to restrict h in order to achieve stability in the numerical 
method, even though the initial value problem itself is stable for all values of h. 
Problems for which a much smaller step size is needed for stability than for accuracy 
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EXAMPLE 

2 

A Stiff 
Problem 


are called stiff. The backward differentiation formulas described in Section 8.4 (of 
which the backward Euler formula is the lowest order example) are the most popular 
formulas for dealing with stiff problems. The following example illustrates the kind of 
instability that can occur when we try to approximate the solution of a stiff problem. 

Consider the initial value problem 

/ = -100y + lOOt + 1, y(0) = 1. (16) 

Find numerical approximations to the solution for 0 < t < 1 using the Euler, backward Euler, 
and Runge-Kutta methods. Compare the numerical results with the exact solution. 

Since the differential equation is linear, it is easy to solve, and the solution of the initial 
value problem (16) is 

y = 4>(t) = e~ mt + t. (17) 

Some values of the solution 0(t), correct to six decimal places, are given in the second column of 
Table 8.6.3, and a graph of the solution is shown in Figure 8.6.2. There is a thin layer (sometimes 
called a boundary layer) to the right of t = 0 in which the exponential term is significant 
and the solution varies rapidly. Once past this layer, however, 0(t) = t and the graph of the 
solution is essentially a straight line. The width of the boundary layer is somewhat arbitrary, 
but it is certainly small. At t = 0.1, for example, exp(—100t) = 0.000045. 


TABLE 8.6.3 Numerical Approximations to the Solution of the Initial Value Problem 
/ = — lOOy + lOOt + 1, y(0) = 1 


t 

Exact 

Euler 

0.025 

Euler 
0.0166... 

Runge-Kutta 
0.0333... 

Runge-Kutta 

0.025 

Backward Euler 
0.1 

0.0 

1.000000 

1.000000 

1.000000 

1.000000 

1.000000 

1.000000 

0.05 

0.056738 

2.300000 

-0.246296 


0.470471 


0.1 

0.100045 

5.162500 

0.187792 

10.6527 

0.276796 

0.190909 

0.2 

0.200000 

25.8289 

0.207707 

111.559 

0.231257 

0.208264 

0.4 

0.400000 

657.241 

0.400059 

1.24 x 10 4 

0.400977 

0.400068 

0.6 

0.600000 

1.68 x 10 4 

0.600000 

1.38 x 10 6 

0.600031 

0.600001 

0.8 

0.800000 

4.31 x 10 5 

0.800000 

1.54 x 10 8 

0.800001 

0.800000 

1.0 

1.000000 

1.11 x 10 7 

1.000000 

1.71 x 10 10 

1.000000 

1.000000 


y 

l 

0.8 

0.6 

0.4 

0.2 


0.2 0.4 0.6 0.8 1 t 


FIGURE 8.6.2 The solution of the initial value problem y' — — lOOy + lOOt + 1, y (0) = 1. 
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If we plan to approximate the solution (17) numerically, we might intuitively expect that a 
small step size will be needed only in the boundary layer. To make this expectation a bit more 
precise, recall from Section 8.1 that the local truncation errors for the Euler and backward 
Euler methods are proportional to For this problem = 10 4 e _100r , which varies from 
a value of 10 4 at t = 0 to nearly zero for t > 0.2. Thus a very small step size is needed for 
accuracy near t = 0, but a much larger step size is adequate once t is a little larger. 

On the other hand, the stability analysis in Eqs. (9) through (15) also applies to this problem. 
Since r = —100 for Eq. (16), it follows that for stability we need h < 0.02 for the Euler method, 
but there is no corresponding restriction for the backward Euler method. 

Some results obtained from the Euler method are shown in columns three and four of 
Table 8.6.3. The values for h = 0.025 are worthless because of instability, while those for 
h = 0.01666... are reasonably accurate for t > 0.2. However, comparable accuracy for this 
range of t is obtained for h = 0.1 by using the backward Euler method, as shown by the results 
in column seven of the table. 

The situation is not improved by using, instead of the Euler method, a more accurate one, 
such as Runge-Kutta. For this problem the Runge-Kutta method is unstable for h = 0.033 ... 
but stable for h = 0.025, as shown by the results in columns five and six of Table 8.6.3. 

The results given in the table for t = 0.05 and for t = 0.1 show that in the boundary layer, 
a smaller step size is needed to obtain an accurate approximation. You are invited to explore 
this matter further in Problem 3. 

The following example illustrates some other difficulties that may be encountered 
in dealing with numerical approximations for unstable differential equations. 


Consider the task of finding numerical approximations to two linearly independent solutions 


EXAMPLE of the second order linear equation 

3 


y” - 10 n 2 y = 0 


(18) 


for t > 0. Note any difficulties that may arise. 

Since we contemplate a numerical approach to this problem, we first convert Eq. (18) into 
a system of two first order equations so that we can use the methods of Section 8.5. Thus we 
let X\ = y and v 2 = y' . In this way we obtain the system 


x[ = X 2 , x' 2 = 107 T 2 Xi, 


or, if x = (xi,x 2 ) r , 



(19) 


The eigenvalues and eigenvectors of the coefficient matrix in Eq. (19) are 



( 20 ) 


so two linearly independent solutions of the system (19) are 



( 21 ) 
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The corresponding solutions of the second order equation (18) are the first components of 
x (1) (0 and x (2) (t):yi(0 = e^ nt and y 2 (t) = e~^ nt , respectively. 

We also wish to consider another pair of linearly independent solutions obtained by forming 
linear combinations of x (1) (t) and x (2) (t): 


and 


= 


cosh a/10 7Tt 
vTOtt sinh VlOnt 


x (4) (0 = ix (1) (0 - ±x (2) (0 = 


sinh VlOjrt 
VIOtt cosh a/10 nt 


( 22 ) 


(23) 


Although the expressions for x (3) (t ) and x (4) ( t ) are quite different, recall that for large t we 
have cosh ^/^07 ^t ~ e^ nt /2 and sinh yTCbrt ~ e^ nt /2. Thus if t is large enough and only a 
fixed number of digits are retained, then numerically the two vector functions x (3) (t ) and x (4) ( t ) 
look exactly the same. For instance, correct to eight digits, we have, for t = 1, 

sinh VlOiT = cosh VlOn = 10,315.894. 

If we retain only eight digits, then the two solutions x (3) ( t ) and x (4) ( t ) are identical at t = 1 and 
indeed for all t > 1. Even if we retain more digits, eventually the two solutions will appear 
(numerically) to be identical. This phenomenon is called numerical dependence. 

For the system (19) we can avoid the issue of numerical dependence by calculating instead 
the solutions x (1) (t) and x (2) (t). From Eq. (21) we know that x (1) (t) is proportional to e^ nt , 
while x (2) (t) is proportional to e ~^ nt , so they behave very differently as t increases. Even so, 
we encounter difficulty in calculating x (2) (t) correctly on a large interval. Observe that x (2) (t ) 
is the solution of Eq. (19) subject to the initial condition 

, " 01 =(2ite) • <24) 


If we attempt to approximate the solution of the initial value problem (19), (24) numerically, 
then at each step of the calculation we introduce truncation and round-off errors. Thus, at 
any point t n , the data to be used in going to the next point are not precisely the values of the 
components of x (2) (t„). The solution of the initial value problem with these data at t n involves 
not only e~^ nt but also e^ 7Tt . Because the error in the data at t n is small, the latter function 
appears with a very small coefficient. Nevertheless, since e~^ nt tends to zero and e^ nt grows 
very rapidly, the latter eventually dominates, and ultimately the calculated solution is very far 
from x (2) (t). 

To be specific, suppose that we try to approximate the solution of the initial value problem 
(19), (24), the first component of which is the solution y 2 (t) = e~^ nt of the second order initial 
value problem 

y" - 107r 2 y = 0, y(0) = 1, y'( 0) = -VTOtt. (25) 

Using the Runge-Kutta method with a step size h = 0.01 and keeping eight digits in the 
calculations, we obtain the results in Table 8.6.4. It is clear from these results that the numerical 
approximation begins to deviate significantly from the exact solution for t > 0.5, and soon 
differs from it by many orders of magnitude. The reason is the presence, in the numerical 
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approximation, of a small component of the exponentially growing quantity e^ nt . With eight¬ 
digit arithmetic we can expect a round-off error of the order of 10 -8 at each step. Since 
gVTojrr g rows by a factor of 3.7 x 10 21 from t = 0 to t = 5, an error of order 10 -8 near t = 0 
can produce an error of order 10 13 at t = 5 even if no further errors are introduced in the 
intervening calculations. The results given in Table 8.6.4 demonstrate that this is exactly what 
happens. 


TABLE 8.6.4 Exact Solution of y" — 10jT 2 y = 0, 
y(0) = 1, y (0) = —VlCkr and Numerical 
Approximation Using the Runge-Kutta Method 
with h = 0.01 


y 

t 

Numerical 

Exact 

0.0 

1.0 



1.0 

0.25 

8.3439 x 10“ 2 

8.3438 x 10“ 2 

0.5 

6.9623 

X 

10 -3 

6.9620 x 10 -3 

0.75 

5.8409 

X 

10- 4 

5.8089 x 10“ 4 

1.0 

8.6688 

X 

10“ 5 

4.8469 x 10“ 5 

1.5 

5.4900 

X 

icr 3 

3.3744 x 10“ 7 

2.0 

7.8852 

X 

io- 1 

2.3492 x IO" 9 

2.5 

1.1326 

X 

10 2 

1.6355 x IO” 11 

3.0 

1.6268 

X 

10 4 

1.1386 x 10“ 13 

3.5 

2.3368 

X 

10 6 

7.9272 x 10“ 16 

4.0 

3.3565 

X 

10 8 

5.5189 x IO” 18 

4.5 

4.8211 

X 

io 10 

3.8422 x IO” 20 

5.0 

6.9249 

X 

10 12 

2.6749 x 10“ 22 


You should bear in mind that the numerical values of the entries in the second column of 
Table 8.6.4 are extremely sensitive to slight variations in how the calculations are executed. 
Regardless of such details, however, the exponential growth of the approximation will be 
clearly evident. 

Equation (18) is highly unstable, and the behavior shown in this example is typical of unstable 
problems. We can track a solution accurately for a while, and the interval can be extended by 
using smaller step sizes or more accurate methods, but eventually the instability in the problem 
itself takes over and leads to large errors. 


Some Comments on Numerical Methods. In this chapter we have introduced several nu¬ 
merical methods for approximating the solution of an initial value problem. We have 
tried to emphasize some important ideas while maintaining a reasonable level of 
complexity. For one thing, we have always used a uniform step size, whereas produc¬ 
tion codes that are currently in use provide for varying the step size as the calculation 
proceeds. 

There are several considerations that must be taken into account in choosing step 
sizes. Of course, one is accuracy; too large a step size leads to an inaccurate result. 
Normally, an error tolerance is prescribed in advance, and the step size at each step 
must be consistent with this requirement. As we have seen, the step size must also be 
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PROBLEMS 


chosen so that the method is stable. Otherwise, small errors will grow and soon render 
the results worthless. Finally, for implicit methods an equation must be solved at each 
step, and the method used to solve the equation may impose additional restrictions 
on the step size. 

In choosing a method, one must also balance the considerations of accuracy and sta¬ 
bility against the amount of time required to execute each step. An implicit method, 
such as the Adams-Moulton method, requires more calculations for each step, but 
if its accuracy and stability permit a larger step size (and consequently fewer steps), 
then this may more than compensate for the additional calculations. The backward 
differentiation formulas of moderate order (say, four) are highly stable and are 
therefore indicated for stiff problems, for which stability is the controlling factor. 

Some current production codes also permit the order of the method to be varied, 
as well as the step size, as the calculation proceeds. The error is estimated at each 
step, and the order and step size are chosen to satisfy the prescribed error tolerance. 
In practice, Adams methods up to order twelve and backward differentiation formu¬ 
las up to order five are in use. Higher order backward differentiation formulas are 
unsuitable because of a lack of stability. 

Finally, we note that the smoothness of the function /—that is, the number of 
continuous derivatives that it possesses—is a factor in choosing the order of the 
method to be used. High order methods lose some of their accuracy if / is not smooth 
to a corresponding order. 


1. To obtain some idea of the possible dangers of small errors in the initial conditions, such 
as those due to round-off, consider the initial value problem 

y = t + y- 3, y(0) = 2. 

(a) Show that the solution is y = 0i (t) = 2 — t. 

(b) Suppose that in the initial condition a mistake is made, and 2.001 is used instead of 2. 
Determine the solution y = 0 2 (O in this case, and compare the difference <fe(0 — 0i(O at 
t = 1 and as t oo. 

2. Consider the initial value problem 

/ = t 2 + e y , y(0) = 0. (i) 

Using the Runge-Kutta method with step size h , we obtain the results in Table 8.6.5. 
These results suggest that the solution has a vertical asymptote between t = 0.9 and t = 1.0. 


TABLE 8.6.5 Approximations to the 
Solution of the Initial Value Problem 
y = t 2 + e y , y(0) = 0 Using the 
Runge-Kutta Method 


h 

t = 0.90 

f = 1.0 

0.02 

3.42985 

> 10 38 

0.01 

3.42982 

V 

o 

u> 

00 
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(a) Let y = (f>(t) be the solution of initial value problem (i). Further, let y = 0i(t) be the 
solution of 


y' = 1 + e y , y(0) = 0, (ii) 

and let y = 0 2 (O be the solution of 

y' — e y , y(0) = 0. (iii) 

Show that 

02(0 < 0(0 < 01 (0 ( 1 V ) 

on some interval, contained in 0 < t < 1, where all three solutions exist. 

(b) Determine 0i(O and 02(0- Then show that 0(0 oo for some t between 
t = In 2 ^ 0.69315 and t = 1. 

(c) Solve the differential equations y' — e y and y' = 1 + e y , respectively, with the initial 
condition y(0.9) = 3.4298. Use the results to show that 0(0 oo when t = 0.932. 

3. Consider again the initial value problem (16) from Example 2. Investigate how small a 
step size h must be chosen to ensure that the error at t = 0.05 and at t = 0.1 is less than 
0.0005. 

(a) Use the Euler method. 

(b) Use the backward Euler method. 

(c) Use the Runge-Kutta method. 

4. Consider the initial value problem 

/ = -10 y + 2.5 1 2 + 0.5 1, y( 0) = 4. 

(a) Find the solution y = 4>{t) and draw its graph for 0 < t < 5. 

(b) The stability analysis in the text suggests that for this problem, the Euler method is 
stable only for h < 0.2. Confirm that this is true by applying the Euler method to this 
problem for 0 < t < 5 with step sizes near 0.2. 

(c) Apply the Runge-Kutta method to this problem for 0 < t < 5 with various step sizes. 
What can you conclude about the stability of this method? 

(d) Apply the backward Euler method to this problem for 0 < t < 5 with various step 
sizes. What step size is needed to ensure that the error at t = 5 is less than 0.01? 

In each of Problems 5 and 6: 

(a) Find a formula for the solution of the initial value problem, and note that it is independent 
of X. 

(b) Use the Runge-Kutta method with h = 0.01 to compute approximate values of the 
solution for 0 < t < 1 for various values of X such as X = 1,10,20, and 50. 

(c) Explain the differences, if any, between the exact solution and the numerical approx¬ 
imations. 

^2/ 5. y' — Xy = 1 — Xt, y(0) = 0 ^2/ 6. y' — Xy = 2t — Xt 2 , 


y(0) = 0 




References 


493 


REFERENCES 


There are many books of varying degrees of sophistication that deal with numerical analysis in general 
and the numerical approximation of solutions of ordinary differential equations in particular. Among 
these are: 

Ascher, Uri M., and Petzold, Linda R., Computer Methods for Ordinary Differential Equations and 
Differential-Algebraic Equations (Philadelphia: Society for Industrial and Applied Mathematics, 
1998). 

Atkinson, Kendall E., Han, Weimin, and Stewart, David, Numerical Solution of Ordinary Differential 
Equations (Hoboken, NJ: Wiley, 2009). 

Gear, C. William, Numerical Initial Value Problems in Ordinary Differential Equations (Englewood Cliffs, 
NJ: Prentice-Hall, 1971). 

Henrici, Peter, Discrete Variable Methods in Ordinary Differential Equations (New York: Wiley, 1962). 

Henrici, Peter, Error Propagation for Difference Methods (NewYork:Wiley, 1963; Huntington, NY: Krieger, 
1977). 

Mattheij, Robert, and Molenaar, Jaap, Ordinary Differential Equations in Theory and Practice 
(New York: Wiley, 1996; Philadelphia: Society for Industrial and Applied Mathematics, 2002). 

Shampine, Lawrence F., Numerical Solution of Ordinary Differential Equations (New York: Chapman and 
Hall, 1994). 

A detailed exposition of Adams predictor-corrector methods, including practical guidelines for 
implementation, may be found in 

Shampine, L. F., and Gordon, M. K., Computer Solution of Ordinary Differential Equations: The Initial 
Value Problem (San Francisco: Freeman, 1975). 

Many books on numerical analysis have chapters on differential equations. For example, at an 
elementary level, see 

Burden, Richard L., and Faires, J. Douglas, Numerical Analysis (9th ed.) (Boston: Brooks/Cole, Cengage 
Learning, 2011). 

The following two books are at a slightly higher level and include information on implementing the 
algorithms in MATLAB. 

Atkinson, Kendall E., and Han, Weimin, Elementary Numerical Analysis (3rd ed.) (Hoboken, NJ: 
Wiley, 2004). 

Shampine, L. F., Gladwell, I., and Thompson, S., Solving ODEs with MATLAB (New York: Cambridge 
University Press, 2003). 




CHAPTER 


Nonlinear 
Differential 
Equations and 
Stability 


There are many differential equations, especially nonlinear ones, that are not sus¬ 
ceptible to analytical solution in any reasonably convenient manner. Numerical 
approximation methods, such as those discussed in the preceding chapter, provide 
one means of dealing with these equations. Another approach, presented in this 
chapter, is geometrical in character and leads to a qualitative understanding of the 
behavior of solutions rather than to detailed quantitative information. 


9.1 The Phase Plane: Linear Systems 


Since many differential equations cannot be solved conveniently by analytical meth¬ 
ods, it is important to consider what qualitative 1 information can be obtained about 
their solutions without actually solving the equations. The questions that we consider 
in this chapter are associated with the idea of stability of a solution, and the methods 
that we employ are basically geometrical. Both the concept of stability and the use 


lr The qualitative theory of differential equations was created by Henri Poincare (1854-1912) in several 
major papers between 1880 and 1886. Poincare was a professor at the University of Paris and is generally 
considered the leading mathematician of his time. He made fundamental discoveries in several differ¬ 
ent areas of mathematics, including complex function theory, partial differential equations, and celestial 
mechanics. In a series of papers beginning in 1894, he initiated the use of modern methods in topology. In 
differential equations he was a pioneer in the use of asymptotic series, one of the most powerful tools of 
contemporary applied mathematics. Among other things, he used asymptotic expansions to obtain solu¬ 
tions about irregular singular points, thereby extending the work of Fuchs and Frobenius discussed in 
Chapter 5. 
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of geometrical analysis were introduced in Chapter 1 and used in Section 2.5 for first 
order autonomous equations 

dy/dt = f(y). (1) 

In this chapter we refine the ideas and extend the discussion to autonomous systems of 
equations. We are particularly interested in nonlinear systems because they typically 
cannot be solved in terms of elementary functions. Further, we consider primarily 
systems of two equations because they lend themselves to geometrical analysis in a 
plane, rather than in a higher-dimensional space. 

However, before taking up nonlinear systems, we want to summarize some of the 
results that we obtained in Chapter 7 for two-dimensional systems of first order linear 
homogeneous equations with constant coefficients. Such a system has the form 

dx/dt = Ax, (2) 

where A is a 2 x 2 constant matrix and x is a 2 x 1 vector. In Sections 7.5 through 7.8, 
we found that we could solve such systems by seeking solutions of the form x = %e rt . 
By substituting for x in Eq. (2), we find that 

(A - rl)$ = 0. (3) 

Thus r must be an eigenvalue and § a corresponding eigenvector of the coefficient 
matrix A. The eigenvalues are the roots of the polynomial equation 

det(A - rl) = 0, (4) 

and the eigenvectors are determined from Eq. (3) up to an arbitrary multiplicative 
constant. Although we presented graphs of solutions of equations of the form (2) 
in Sections 7.5, 7.6, and 7.8, our main emphasis there was on finding a convenient 
expression for the general solution. Our goal in this section is to bring together the 
geometrical information for linear systems in one place. We use this information in 
the rest of the chapter to investigate the much more difficult nonlinear systems. 

In Section 2.5 we found that points where the right side of Eq. (1) is zero are 
of special importance. Such points correspond to constant solutions, or equilibrium 
solutions, of Eq. (1) and are often called critical points. Similarly, for the system (2), 
points where Ax = 0 correspond to equilibrium (constant) solutions, and again they 
are called critical points. We will assume that A is nonsingular, or that det A ^ 0. It 
follows that x = 0 is the only critical point of the system (2). 

Recall that a solution of Eq. (2) is a vector function x = </>(t) that satisfies the differ¬ 
ential equation. Such a function can be viewed as a parametric representation for a 
curve in the xiX 2 -plane. It is often useful to regard this curve as the path, or trajectory, 
traversed by a moving particle whose velocity dx/dt is specified by the differential 
equation. The xiX 2 -plane itself is called the phase plane, and a representative set of 
trajectories is referred to as a phase portrait. 

In analyzing the system (2), we must consider several different cases, depending 
on the nature of the eigenvalues of A. We will characterize the differential equation 
according to the geometric pattern formed by its trajectories. In each case we discuss 
the behavior of the trajectories in general and illustrate it with an example. It is 
important that you become familiar with the types of behavior that the trajectories 
have for each case, because these are the basic ingredients of the qualitative theory 
of differential equations. 
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CASE 1 


Real, Unequal Eigenvalues of the Same Sign. In this case, the general solution of 
Eq. (2) is 

X = ci£ (1 V ir + c 2 £ ( V 2f , (5) 


where r\ and r 2 are either both positive or both negative. Suppose first that 
r\ < r 2 < 0 and that the eigenvectors § (1) and § (2) are as shown in Figure 9.1.1a. 
It follows from Eq. (5) that x -> 0 as t 00 regardless of the values of c\ and C 2 ; in 
other words, all solutions approach the critical point at the origin as t -> 00 . If the 
solution starts at an initial point on the line through § (1) , then C 2 = 0. Consequently, 
the solution remains on the line through § (1) for all t and approaches the origin as 
t -> 00 . Similarly, if the initial point is on the line through § (2) , then the solution 
approaches the origin along that line. In the general situation, it is helpful to rewrite 
Eq. (5) in the form 

x = eP* [c^e^-^ + c 2 £ (2) ] . (6) 

Observe that ri — r 2 < 0. Therefore, as long as C 2 7 ^ 0, the term ci§ (1) exp[(ri — r 2 )t] 
is of negligible magnitude compared to that of c 2 ^ 2) for t sufficiently large. Thus, 
as t -> oc, the trajectory not only approaches the origin but also tends toward the 
line through § (2) . Hence all solutions are tangent to § (2) at the critical point except 
for those solutions that start exactly on the line through § (1) . Several trajectories are 
sketched in Figure 9.1.1a. Typical graphs of x\ versus t are shown in Figure 9.1. lb, 
illustrating that all solutions exhibit exponential decay in time. The behavior of X 2 
versus t is similar. This type of critical point is called a node or a nodal sink. 



Let us now look backward in time and inquire what happens as t -> — 00 . Still 
assuming that r\ < r 2 < 0, we note that if c\ / 0, then the dominant term in Eq. (5) 
as t ^ —00 is the term involving e rit . Thus, except for the trajectories lying along the 
line through § (2) , for large negative t the trajectories have slopes that are very nearly 
that of the eigenvector § (1) . This is also indicated in Figure 9.1.1a. 

If r\ and r 2 are both positive, and 0 < r 2 < r\, then the trajectories have the same 
pattern as in Figure 9.1.1a, but the direction of motion is away from, rather than 
toward, the critical point at the origin. In this case x\ and x 2 grow exponentially as 
functions of t. Again the critical point is called a node or a nodal source. 

An example of a node occurs in Example 3 of Section 7.5, and its trajectories are 
shown in Figure 7.5.4. 







498 


Chapter 9 . Nonlinear Differential Equations and Stability 


CASE 2 Real Eigenvalues of Opposite Sign. The general solution of Eq. (2) is 

X = + c 2 § ( V 2 ' , (7) 

where r\ > 0 and r 2 < 0. Suppose that the eigenvectors § (1) and £ (2) are as shown 
in Figure 9.1.2#. If the solution starts at an initial point on the line through § (1) , 
then it follows that c 2 = 0. Consequently, the solution remains on the line through 
§ (1) for all t , and since r\ > 0, ||x|| -> oo as t -> oo. If the solution starts at an ini¬ 
tial point on the line through § (2) , then it always remains on this line and ||x|| -> 0 
as t -> oo because r 2 < 0. For solutions starting at other initial points the positive 
exponential is the dominant term in Eq. (7) for large t , so eventually all these solu¬ 
tions approach infinity asymptotic to the line determined by the eigenvector § (1) 
corresponding to the positive eigenvalue r \. The only solutions that approach the 
critical point at the origin are those that start precisely on the line determined by 
§ (2) . For large negative t , the dominant term in Eq. (7) is the negative exponen¬ 
tial, so a typical solution is asymptotic to the line through the eigenvector § (2) as 
t -> — oo. The exceptions are those solutions that lie exactly on the line through the 
eigenvector § (1) ; these solutions approach the origin as t -> — oo. The phase portrait 
shown in Figure 9.1.2# is typical of the case in which the eigenvalues are real and of 
opposite sign. The origin is called a saddle point in this case. 

Figure 9.1.26 shows some typical graphs of x\ versus t. For certain initial conditions 
the positive exponential term is absent from the solution, so %i -> 0 as t -> oo. For 
all other initial conditions the positive exponential term eventually dominates and 
causes xi to be unbounded. The behavior of x 2 is similar. 

An example of a saddle point occurs in Example 2 of Section 7.5, and its trajectories 
are shown in Figure 7.5.2. 



FIGURE 9.1.2 


(a) 

A saddle point; r\ > 0, r 2 < 


G b ) 

0. (a) The phase plane. ( b ) x\ versus t. 


CASE 3 Equal Eigenvalues. We now suppose that r\ — r 2 = r. We consider the case in 
which the eigenvalues are negative; if they are positive, the trajectories are similar 
but the direction of motion is reversed. There are two subcases, depending on whether 
the repeated eigenvalue has two independent eigenvectors or only one. 

(a) Two independent eigenvectors. The general solution of Eq. (2) is 

X = c 1 f ) e rt + c 2 ^ 2) e rt , 


(8) 
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where § (1) and § (2) are the independent eigenvectors. The ratio x 2 /xi is independent 
of t but depends on the components of § (1) and § (2) and on the arbitrary constants 
c 1 and C 2 . Thus every trajectory lies on a straight line through the origin, as shown 
in Figure 9.1.3#. Typical graphs of x\ or %2 versus t are shown in Figure 9.1.3 b. The 
critical point is called a proper node, or sometimes a star point. 



(a) 


(b) 


FIGURE 9.1.3 A proper node, two independent eigenvectors; r\ = r 2 < 0. 
(a) The phase plane. ( b ) x\ versus t. 


(b) One independent eigenvector. As shown in Section 7.8, the general solution 
of Eq. (2) in this case is 

x = ci%e rt + c 2 (%te rt + rje rt ), (9) 

where § is the eigenvector and rj is the generalized eigenvector associated with the 
repeated eigenvalue. For large t the dominant term in Eq. (9) is c 2 %te rt . Thus, as 
t -> oc, every trajectory approaches the origin tangent to the line through the eigen¬ 
vector. This is true even if C2 = 0, for then the solution x = c\%e rt lies on this line. 
Similarly, for large negative t the term c 2 %te rt is again the dominant one, so as 
t —> —00, the slope of each trajectory approaches the slope of the eigenvector §. 

The orientation of the trajectories depends on the relative positions of § and rj. 
One possible situation is shown in Figure 9.1.4#. To locate the trajectories, it is helpful 
to write the solution (9) in the form 

X = [(Cil + c 2 ri) + C 2 $t]e rt = ye n , (10) 

where y = (ci§ + c 2 rj) + c 2 %t. Observe that the vector y determines the direction of 
x, whereas the scalar quantity e rt affects only the magnitude of x. Also note that for 
fixed values of c\ and C 2 , the expression for y is a vector equation of the straight line 
through the point ci§ + c 2 rj and parallel to §. 

To sketch the trajectory corresponding to a given pair of values of c\ and C2,y° u can 
proceed in the following way. First, draw the line given by (ci§ + c 2 rj) + c 2 %t and note 
the direction of increasing t on this line. Two such lines are shown in Figure 9.1.4#, one 
forc 2 > 0 and the other for C 2 < 0. Next, note that the given trajectory passes through 
the point ci§ + c 2 rj when t = 0. Further, as t increases, the direction of the vector x 
given by Eq. (10) follows the direction of increasing t on the line, but the magnitude of 
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x rapidly decreases and approaches zero because of the decaying exponential factor 
e rt . Finally, as t decreases toward — oo, the direction of x is determined by points on 
the corresponding part of the line, and the magnitude of x approaches infinity. In 
this way we obtain the black trajectories in Figure 9.1.4*2. A few other trajectories 
are sketched as well, to help complete the diagram. Typical graphs of x\ versus t are 
shown in Figure 9XAb. 

The other possible situation is shown in Figure 9.1.4c, where the relative orientation 
of § and rj is reversed. As indicated in the figure, this results in a reversal in the 
orientation of the trajectories. 


Xi > 



t 




FIGURE 9.1.4 An improper node, one independent eigenvector; r\ = r 2 < 0. 

(a) The phase plane, (b) x\ versus t. (c) The phase plane for the same £ and a different rj. 

If n = r 2 > 0, you can sketch the trajectories by following the same procedure. In 
this event the trajectories are traversed in the outward direction, and the orientation 
of the trajectories with respect to that of § and rj is also reversed. 

When a double eigenvalue has only a single independent eigenvector, the critical 
point is called an improper or degenerate node. A specific example of this case is 
Example 2 in Section 7.8; the trajectories are shown in Figure 7.8.2. 
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CASE 4 Complex Eigenvalues with Nonzero Real Part. Suppose that the eigenvalues are 
k ± i/i , where k and /i are real, 1^0, and \i> 0. In Section 7.6 it was shown that it is 
possible to write the general solution in terms of the eigenvalues and eigenvectors. 
However, we proceed in a different way. 

Let us consider the system 


x = 




(ii) 


whose scalar form is 


x[ = kx 1 + fix 2 , X 2 = —fix 1 + kx 2 . ( 12 ) 

It is sufficient to examine the system (11) since every 2x2 system with eigenvalues 
k ± ifi can be converted into the form (11) by a linear transformation (an example 
of how this can be done is found in Problem 22). We introduce the polar coordinates 
r, 0 given by 

r 2 = x\ + x 2 , tan 0 = X 2 /x\. 

By differentiating these equations, we obtain 

rr ! = x\x! x + X 2 X 2 , (sec 2 0)0' = {x\x! 2 — X 2 x' 1 )/x\. (13) 

Substituting from Eqs. (12) in the first of Eqs. (13), we find that 

r' = kr, (14) 

and hence 

r = (15) 

where c is a constant. Similarly, substituting from Eqs. (12) in the second of Eqs. (13), 
and using the fact that sec 2 0 = r 2 /x 2 , we have 

O' — —fi. (16) 

Hence 

0 = —fit + 0q, (17) 


where $o is the value of 0 when t = 0 . 

Equations (15) and (17) are parametric equations in polar coordinates of the tra¬ 
jectories of the system (11). Since fi > 0, it follows from Eq. (17) that 0 decreases 
as t increases, so the direction of motion on a trajectory is clockwise. As t oo, we 
see from Eq. (15) that r 0 if k < 0 and r oo if k > 0. Thus the trajectories are 
spirals, which approach or recede from the origin, depending on the sign of k. Both 
possibilities are shown in Figure 9.1.5, along with some typical graphs of x\ versus t. 
The critical point is called a spiral point in this case. Frequently, the terms spiral sink 
and spiral source, respectively, are used to refer to spiral points whose trajectories 
approach, or depart from, the critical point. 
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(c) (d) 

FIGURE 9.1.5 A spiral point; r\ = X + i/x, r 2 = X — iji. {a) X < 0, the phase plane. 
(b) X < 0, x\ versus t. (c) X > 0, the phase plane. ( d ) X > 0, x\ versus t. 


CASE 5 


More generally, the trajectories are spirals for any system with complex eigenval¬ 
ues X zb ifi, where X ^ 0. The spirals are traversed in the inward or outward direction, 
depending on whether X is negative or positive. They may be elongated and skewed 
with respect to the coordinate axes, and the direction of motion may be either clock¬ 
wise or counterclockwise. Further, it is easy to obtain a general idea of the orientation 
of the trajectories directly from the differential equations. Suppose that 


dx/dt\ fa b\ fx\ 
dy/dt) ~ \c d) Vy/ 


(18) 


has complex eigenvalues X ± //x, and look at the point (0,1) on the positive y-axis. At 
this point it follows from Eqs. (18) that dx/dt = b and dy/dt = d. Depending on the 
signs of b and d , we can infer the direction of motion and the approximate orientation 
of the trajectories. For instance, if both b and d are negative, then the trajectories cross 
the positive y-axis so as to move down and into the second quadrant. If X < 0 also, then 
the trajectories must be inward-pointing spirals resembling the one in Figure 9.1.6. 
Another case was given in Example 1 of Section 7.6, whose trajectories are shown in 
Figure 7.6.2. 

Pure Imaginary Eigenvalues. In this case X = 0, and the system (11) reduces to 


x 




(19) 


with eigenvalues Using the same argument as in Case 4, we find that 


0 , 


0 ' = -H, 


( 20 ) 
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FIGURE 9.1.6 A spiral point; r = X±ifi with A < 0. 


and consequently, 

r = c, 0 = -/it + 0 O , (21) 

where c and 0 o are constants. Thus the trajectories are circles, with center at the origin, 
that are traversed clockwise if /x > 0 and counterclockwise if /x < 0. A complete 
circuit about the origin is made in a time interval of length 27t//x, so all solutions are 
periodic with period 27t//x. The critical point is called a center. 

In general, when the eigenvalues are pure imaginary, it is possible to show (see 
Problem 19) that the trajectories are ellipses centered at the origin. A typical situation 
is shown in Figure 9.1.7, which also includes some typical graphs of x\ versus t. See 
also Example 3 in Section 7.6, especially Figures 7.6.3 and 7.6.4. 





lywWw' 



FIGURE 9.1.7 A center; r\ — in, r 2 = —z/x. ( a ) The phase plane. ( b ) x\ versus t. 


By reflecting on these five cases and by examining the corresponding figures, we 
can make several observations: 

1. After a long time, each individual traj ectory exhibits one of only three types of behavior. As 
t oo, each trajectory approaches the critical point x = 0 , repeatedly traverses a closed 
curve (corresponding to a periodic solution) that surrounds the critical point, or becomes 
unbounded. 
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2. Viewed as a whole, the pattern of trajectories in each case is relatively simple. To be 

more specific, through each point (x 0 ,yo) i n the phase plane there is only one trajectory; 
thus the trajectories do not cross each other. Do not be misled by the figures, in which 
it sometimes appears that many trajectories pass through the critical point x = 0. In fact, 
the only solution passing through the origin is the equilibrium solution x = 0. The other 
solutions that appear to pass through the origin actually only approach this point as t oo 

or t —oo. 

3. In each case, the set of all trajectories is such that one of three situations occurs. 

(a) All trajectories approach the critical point x = 0 as t -> oo. This is the case if the 
eigenvalues are real and negative or complex with negative real part. The origin is 
either a nodal sink or a spiral sink. 

(b) All trajectories remain bounded but do not approach the origin as t oo. This is the 
case if the eigenvalues are pure imaginary. The origin is a center. 

(c) Some trajectories, and possibly all trajectories except x = 0, become unbounded as 
t -> oo. This is the case if at least one of the eigenvalues is positive or if the eigenvalues 
have positive real part. The origin is a nodal source, a spiral source, or a saddle point. 

The situations described in 3(a), (b), and (c) above illustrate the concepts of asymp¬ 
totic stability, stability, and instability, respectively, of the equilibrium solution x = 0 
of the system (2). The precise definitions of these terms are given in Section 9.2, 
but their basic meaning should be clear from the geometrical discussion in this sec¬ 
tion. The information that we have obtained about the system (2) is summarized in 
Table 9.1.1. Also see Problems 20 and 21. 


TABLE 9.1.1 Stability Properties of Linear Systems x' = Ax with 
det(A - rl) = 0 and det A ^ 0 


Eigenvalues 

Type of Critical Point 

Stability 

r\ > r 2 > 0 

Node 

Unstable 

r\ < r 2 < 0 

Node 

Asymptotically stable 

r 2 < 0 < r\ 

Saddle point 

Unstable 

n = r 2 > 0 

Proper or improper node 

Unstable 

n = r 2 < 0 

Proper or improper node 

Asymptotically stable 

r \, r 2 — X ± ifi 

Spiral point 


X>0 


Unstable 

X<0 


Asymptotically stable 

r\ = ifi, r 2 = —in 

Center 

Stable 


The analysis in this section applies only to second order systems x' = Ax whose 
solutions can be visualized as curves in the phase plane. A similar, though more 
complicated, analysis can be carried out for an nth order system, with an n x n 
coefficient matrix A, whose solutions are represented geometrically by curves in 
an /^-dimensional phase space. The cases that can occur in higher order systems are 
essentially combinations of those we have seen in two dimensions. For instance, in 
a third order system with a three-dimensional phase space, one possibility is that 
solutions in a certain plane may spiral toward the origin, while other solutions may 
tend to infinity along a line transverse to this plane. This will be the case if the coef¬ 
ficient matrix has two complex eigenvalues with negative real part and one positive 
real eigenvalue. However, because of their complexity, we will not discuss systems of 
higher than second order. 
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PROBLEMS 


41 

41 

41 

41 

41 

41 


For each of the systems in Problems 1 through 12: 

(a) Find the eigenvalues and eigenvectors. 

(b) Classify the critical point (0,0) as to type, and determine whether it is stable, asymptotically 
stable, or unstable. 

(c) Sketch several trajectories in the phase plane, and also sketch some typical graphs of x\ 
versus t. 

(d) Use a computer to plot accurately the curves requested in part (c). 



41 2 - 

41 4. 
41 6 . 
48 8 - 
41 10 - 
41 12 - 


dx 

dt 

dx 

dt 

dx 

dt 

dx 

dt 

dx 

dt 

dx 

dt 



x 


x 



X 




X 




X 



X 


In each of Problems 13 through 16, determine the critical point x = x°, and then classify its 
type and examine its stability by making the transformation x = x° + u. 



16. 


dx 

dt 


0 -p 
8 0 


x + 


a, p, y, 8 > 0 


17. The equation of motion of a spring-mass system with damping (see Section 3.7) is 


d 2 u du 

m-— + c— +ku = 0, 
dt 2 dt 


where m, c, and k are positive. Write this second order equation as a system of two first 
order equations for x = u, y = du/dt. Show that x = 0, y = 0 is a critical point, and analyze 
the nature and stability of the critical point as a function of the parameters m, c, and k. A 
similar analysis can be applied to the electric circuit equation (see Section 3.7) 
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18. Consider the system x' = Ax, and suppose that A has one zero eigenvalue. 

(a) Show that det(A) = 0. 

(b) Show that x = 0 is a critical point and that, in addition, every point on a certain straight 
line through the origin is also a critical point. 

(c) Let ri = 0 and r 2 ^ 0, and let £ (1) and £ (2) be corresponding eigenvectors. Show that 
the trajectories are as indicated in Figure 9.1.8. What is the direction of motion on the 
trajectories? 



FIGURE 9.1.8 Nonisolated critical points; r\ = 0, r 2 ^ 0. Every point 
on the line through £ (1) is a critical point. 


19. In this problem we indicate how to show that the trajectories are ellipses when the 
eigenvalues are pure imaginary. Consider the system 



(a) Show that the eigenvalues of the coefficient matrix are pure imaginary if and only if 

an + a 2 2 = 0, ^ 11^22 — a\ 2 a 2 \ > 0. (ii) 

(b) The trajectories of the system (i) can be found by converting Eqs. (i) into the single 
equation 

dy dy/dt a 2 \X + a 22 y 
dx dx/dt anx + a\ 2 y' 

Use the first of Eqs. (ii) to show that Eq. (iii) is exact. 

(c) By integrating Eq. (iii), show that 

a 2 \x 2 + 2a 22 xy — a\ 2 y 2 = k , 

where k is a constant. Use Eqs. (ii) to conclude that the graph of Eq. (iv) is always an 
ellipse. 

Hint: What is the discriminant of the quadratic form in Eq. (iv)? 


(iii) 


(iv) 
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20. Consider the linear system 

dx/dt = a\\x + any, dy/dt = a 2 ix + a 22 y , 

where 011 , 012 , 021 , and a 22 are real constants. Let p = an + a 22 , q = 011022 — 012021 > and 
A = p 2 — 4q. Observe that p and q are the trace and determinant, respectively, of the 
coefficient matrix of the given system. Show that the critical point (0,0) is a 

(a) Node if q > 0 and A > 0; (b) Saddle point if q < 0; 

(c) Spiral point if p ^ 0 and A < 0; (d) Center if p = 0 and q > 0. 

Hint: These conclusions can be reached by studying the eigenvalues and r 2 . It may also 
be helpful to establish, and then to use, the relations r\r 2 = q and r\ + r 2 = p. 

21. Continuing Problem 20, show that the critical point (0,0) is 

(a) Asymptotically stable if q > 0 and p < 0; 

(b) Stable if q > 0 and p = 0; 

(c) Unstable if q < 0 or p > 0. 

The results of Problems 20 and 21 are summarized visually in Figure 9.1.9. 



FIGURE 9.1.9 Stability diagram. 


22. In this problem we illustrate how a 2 x 2 system with eigenvalues k ± ip can be 
transformed into the system (11). Consider the system in Problem 12: 


' 2 —2.5\ 

1.8 -l) 


(a) Show that the eigenvalues of this system are r\ — 0.5 + 1.5/ and r 2 = 0.5 — 1.5/. 

(b) Show that the eigenvector corresponding to r\ can be chosen as 


s a) (b) = 




(ii) 
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(c) Let P be the matrix whose columns are the real and imaginary parts of £ (1) . Thus 



Let x = Py and substitute for x in Eq. (i). Show that 

y' = (P AP)y (iv) 


(d) Find P 1 and show that 


P X AP 


0.5 

-1.5 



Thus Eq. (v) has the form of Eq. (11). 


(V) 


9.2 Autonomous Systems and Stability 


In this section we begin to draw together, and to expand on, the geometrical ideas 
introduced in Section 2.5 for certain first order equations and in Section 9.1 for 
systems of two first order linear homogeneous equations with constant coefficients. 
These ideas concern the qualitative study of differential equations and the concept 
of stability, an idea that will be defined precisely later in this section. 

Autonomous Systems. We are concerned with systems of two simultaneous differential 
equations of the form 

dx/dt = F(x,y), dy/dt = G(x,y). (1) 

We assume that the functions F and G are continuous and have continuous partial 
derivatives in some domain D of the xy-plane. If (xo,yo) is a point in this domain, 
then by Theorem 7.1.1 there exists a unique solution x = 0(0, y = 0(0 of the system 
(1) satisfying the initial conditions 

x(t 0 ) = x 0 , y(to) = yo- (2) 

The solution is defined in some time interval I that contains the point to. 

Frequently, we will write the initial value problem (1), (2) in the vector form 

dx/dt = f(x), x(to) = x°, (3) 

where x = (x,y) T , f(x) = ( F(x,y ), G(x,y)) T , and x° = (xo,yo) T • In this case the solu¬ 
tion is expressed as x = 0(0, where 0(0 = (0(O,0(O) r - As usual, we interpret a 
solution x = 0(0 as a curve traced by a moving point in the xy-plane, the phase 
plane. 

Observe that the functions F and G in Eqs. (1) do not depend on the independent 
variable t, but only on the dependent variables x and y. A system with this property 
is said to be autonomous. The system 


x' = Ax, 


( 4 ) 





9.2 Autonomous Systems and Stability 


509 


where A is a constant 2x2 matrix, is a simple example of a two-dimensional 
autonomous system. On the other hand, if one or more of the elements of the 
coefficient matrix A is a function of the independent variable t , then the system 
is nonautonomous. The distinction between autonomous and nonautonomous sys¬ 
tems is important, because the geometrical qualitative analysis in Section 9.1 can be 
effectively extended to two-dimensional autonomous systems in general but is not 
nearly as useful for nonautonomous systems. 

In particular, the autonomous system (1) has an associated direction field that is 
independent of time. Consequently, there is only one trajectory passing through each 
point (jco,yo) i n the phase plane. In other words, all solutions that satisfy an initial 
condition of the form (2) lie on the same trajectory, regardless of the time to at which 
they pass through (JCo,yo)- Thus, just as for the constant coefficient linear system (4), 
a single phase portrait simultaneously displays important qualitative information 
about all solutions of the system (1). We will see this fact confirmed repeatedly in 
this chapter. 

Autonomous systems occur frequently in applications. Physically, an autonomous 
system is one whose configuration, including physical parameters and external forces 
or effects, is independent of time. The response of the system to given initial conditions 
is then independent of the time at which the conditions are imposed. 

Stability and Instability. The concepts of stability, asymptotic stability, and instability 
have already been mentioned several times in this book. It is now time to give a 
precise mathematical definition of these concepts, at least for autonomous systems 
of the form 


x' = f(x). (5) 

In the following definitions, and elsewhere, we use the notation ||x|| to designate the 
length, or magnitude, of the vector x. 

The points, if any, where f(x) = 0 are called critical points of the autonomous 
system (5). At such points x' = 0 also, so critical points correspond to constant, or 
equilibrium, solutions of the system of differential equations. A critical point x° of 
the system (5) is said to be stable if, given any e > 0, there is a 8 > 0 such that every 
solution x = 0(t) of the system (1), which at t = 0 satisfies 

110(0) — x°|| < S, (6) 

exists for all positive t and satisfies 

110(0-X° II <€ (7) 

for all t > 0. This is illustrated geometrically in Figures 92.1a and 9.2.1 b. These 
mathematical statements say that all solutions that start “sufficiently close” (that 
is, within the distance 8) to x° stay “close” (within the distance e) to x°. Note that in 
Figure 9.2.1a the trajectory is within the circle ||x — x°|| = 8 at t = 0 and, although 
it soon passes outside of this circle, it remains within the circle ||x — x°|| = € for all 
t > 0. However, the trajectory of the solution does not have to approach the critical 
point x° as t oo; it only has to remain within the circle of radius e, as illustrated in 
Figure 9.2.15. A critical point that is not stable is said to be unstable. 
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FIGURE 9.2.1 ( a ) Asymptotic stability. ( b ) Stability. 

A critical point x° is said to be asymptotically stable if it is stable and if there exists 
a 8o (<$o > 0) such that if a solution x = 0(0 satisfies 

||0(O) — x°II <S 0 , (8) 

then 

lim 0(0 = x°. (9) 

7—O 

Thus trajectories that start “sufficiently close” to x° not only must stay “close” but 
must eventually approach x° as t -> oo. This is the case for the trajectory in Figure 
9.2.1a, but not for the one in Figure 9.2.1 b. Note that asymptotic stability is a stronger 
property than stability, since a critical point must be stable before we can even con¬ 
sider whether it might be asymptotically stable. On the other hand, the limit condition 
(9), which is an essential feature of asymptotic stability, does not by itself imply even 
ordinary stability. Indeed, examples can be constructed in which all the trajectories 
approach x° as t -> oo, but for which x° is not a stable critical point. Geometrically, 
all that is needed is a family of trajectories having members that start arbitrarily close 
to x° and then depart an arbitrarily large distance before eventually approaching x° 
as t oo. 

In this chapter we are concentrating on systems of two equations, but the definitions 
just given are independent of the size of the system. If you interpret the vectors in 
Eqs. (5) through (9) as a-dimensional, then the definitions of stability, asymptotic 
stability, and instability apply also to systems of n equations. The concepts expressed 
in these definitions can be seen more clearly by interpreting them in terms of a specific 
physical problem. 

The Oscillating Pendulum. The concepts of asymptotic stability, stability, and instability 
can be easily visualized in terms of an oscillating pendulum. Consider the configura¬ 
tion shown in Figure 9.2.2, in which a mass m is attached to one end of a rigid, but 
weightless, rod of length L. The other end of the rod is supported at the origin (9, 
and the rod is free to rotate in the plane of the paper. The position of the pendu¬ 
lum is described by the angle 0 between the rod and the downward vertical direction, 
with the counterclockwise direction taken as positive. The gravitational force mg acts 
downward, while the damping force c\dO/dt\, where c is positive, is always opposite to 
the direction of motion. We assume that both 0 and dO/dt are positive. The equation 
of motion can be quickly derived from the principle of angular momentum, which 
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states that the time rate of change of angular momentum about any point is equal 
to the moment of the resultant force about that point. The angular momentum about 
the origin is mL 2 (dO/dt ), so the governing equation is 


mL 2 


d 2 0 
dt 2 


T d0 r . „ 

—cL— - mgL sin 0. 

dt 


( 10 ) 


The factors L and LsinO on the right side of Eq. (10) are the moment arms of 
the resistive force and of the gravitational force, respectively; the minus signs are due 
to the fact that the two forces tend to make the pendulum rotate in the clockwise 
(negative) direction. You should verify, as an exercise, that the same equation is 
obtained for the other three possible sign combinations of 0 and d0/dt. 



FIGURE 9.2.2 An oscillating pendulum. 


By straightforward algebraic operations, we can write Eq. (10) in the standard form 


or 


d 2 0 c dO g . 

"jy H- — —j —f — sin 0 ■ 

dt A mL dt L 


0 , 


d 2 0 


dO 


—ry + y ——V co sin 0 — 0 , 


dt 2 


dt 


(in 

( 12 ) 


where y = c/mL and co 2 = g/L. To convert Eq. (12) to a system of two first order 
equations, we let x = 0 and y = dO/dt ; then 

dx dy o . 

— = y, — = —co sinx - yy. (13) 


Since y and co 2 are constants, the system (13) is an autonomous system of the 
form (1). 

The critical points of Eqs. (13) are found by solving the equations 
V = 0, —co 2 sin* — yy = 0. 


We obtain y = 0 and v = ±nn, where n is an integer. These points correspond to two 
physical equilibrium positions, one with the mass directly below the point of support 
(6 = 0) and the other with the mass directly above the point of support (0 = it). Our 
intuition suggests that the first is stable and the second is unstable. 
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More precisely, if the mass is slightly displaced from the lower equilibrium posi¬ 
tion, it will oscillate back and forth with gradually decreasing amplitude, eventually 
converging to the equilibrium position as the initial potential energy is dissipated by 
the damping force. This type of motion illustrates asymptotic stability and is shown 
in Figure 923a. 


\ 

\ 

\ 

\ 

\ 

\ 

\ 


\ 


\ 


\ 




(a) ( b ) (c) 

FIGURE 9.2.3 Qualitative motion of a pendulum, (a) With air resistance. 
( b ) With or without air resistance, (c) Without air resistance. 


On the other hand, if the mass is slightly displaced from the upper equilib¬ 
rium position, it will rapidly fall, under the influence of gravity, and will ultimately 
converge to the lower equilibrium position in this case also. This type of motion 
illustrates instability. See Figure 9.23b. In practice, it is impossible to maintain the 
pendulum in its upward equilibrium position for any extended length of time with¬ 
out an external constraint mechanism, since the slightest perturbation will cause the 
mass to fall. 

Finally, consider the ideal situation in which the damping coefficient c (or y) is 
zero. In this case, if the mass is displaced slightly from its lower equilibrium position, 
it will oscillate indefinitely with constant amplitude about the equilibrium position. 
Since there is no dissipation in the system, the mass wifi remain near the equilib¬ 
rium position but wifi not approach it asymptotically. This type of motion is stable 
but not asymptotically stable, as indicated in Figure 9.2.3c. In general, this motion is 
impossible to achieve experimentally, because the slightest degree of air resistance 
or friction at the point of support wifi eventually cause the pendulum to converge to 
its rest position. 

Solutions of the pendulum equations are discussed in more detail in the next 
section. 


The Importance of Critical Points. Critical points correspond to equilibrium solutions— 
that is, solutions for which x(t) and y(t) are constant. For such a solution, the system 
described by x and y is not changing; it remains in its initial state forever. It might 
seem reasonable to conclude that such points are not very interesting. Recall, how¬ 
ever, that for linear homogeneous systems with constant coefficients, x' = Ax, the 
nature of the critical point at the origin determines to a large extent the behavior of 
trajectories throughout the xy -plane. 

For nonlinear autonomous systems this is no longer true, for at least two reasons. 
First, there may be several, or many, critical points that are competing, so to speak, 
for influence on the trajectories. Second, the nonlinearities in the system are also of 
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great importance, especially far away from the critical points. Nevertheless, critical 
points of nonlinear autonomous systems can be classified just as for linear systems. 
We will discuss this in detail in Section 9.3. Here we illustrate how it can be done 
graphically, assuming that you have software that can construct direction fields and 
perhaps plot good numerical approximations to a few trajectories. 


EXAMPLE 

1 


Consider the system 

dx/dt = —(x — y)(l — x — y), dy/dt = x(2 + y). (14) 

Find the critical points for this system, and draw direction fields on rectangles containing the 
critical points. By inspecting the direction fields, classify each critical point as to type, and state 
whether it is asymptotically stable, stable, or unstable. 

The critical points are found by solving the algebraic equations 

(x y)(l x y) — 0, x(2 + y) = 0. (15) 

One way to satisfy the second equation is by choosing x — 0. Then the first equation becomes 
y (1 — y) = 0, so y = 0 or y = 1. More solutions can be found by choosing y = — 2 in the second 
equation. Then the first equation becomes {x + 2) (3 — x) = 0, so x = —2 or x = 3. Thus we 
have obtained the four critical points (0,0), (0, 1), (-2, -2), and (3, -2). 

Figure 9.2.4 shows a direction field containing the first two of the critical points. Comparing 
this figure with those in Section 9.1 and in Chapter 7 should make it clear that the origin is 
a saddle point and that (0,1) is a spiral point. Of course, the saddle point is unstable. The 
trajectories near the spiral point appear to be approaching this point, so we conclude that it is 
asymptotically stable. A direction field for the other two critical points is shown in Figure 9.2.5. 
Each of these points is a node. The arrows point toward the point (—2, —2) and away from the 
point (3, —2); thus the former is asymptotically stable and the latter is unstable. 



FIGURE 9.2.4 Direction field for the 
system (14) containing the critical 
points (0,0) and (0,1); the former is a 
saddle point and the latter is a spiral point. 


FIGURE 9.2.5 Direction field for the 
system (14) containing the critical points 
(-2, -2) and (3, -2); both of these points 
are nodes. 
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EXAMPLE 

2 


For a two-dimensional autonomous system with at least one asymptotically stable 
critical point, it is often of interest to determine where in the phase plane the tra¬ 
jectories lie that ultimately approach a given critical point. Let P be a point in the 
xy-plane with the property that a trajectory passing through P ultimately approaches 
the critical point as t oo. Then this trajectory is said to be attracted by the critical 
point. Further, the set of all such points P is called the basin of attraction or the 
region of asymptotic stability of the critical point. A trajectory that bounds a basin 
of attraction is called a separatrix because it separates trajectories that approach 
a particular critical point from other trajectories that do not do so. Determination 
of basins of attraction is important in understanding the large-scale behavior of the 
solutions of an autonomous system. 

Consider again the system (14) from Example 1. Describe the basin of attraction for each of 
the asymptotically stable critical points. 

Figure 9.2.6 shows a phase portrait for this system with a direction field in the background. 
Observe that there are two trajectories that approach the saddle point at the origin as t -> oo, 
One of these lies in the fourth quadrant and is almost a straight line from the unstable node 
at (3, —2). The other also originates at the unstable node, then passes into the first quadrant, 
loops around the spiral point, and ultimately approaches the saddle point through the second 
quadrant. These two trajectories are separatrices; the region between them (but not including 
the separatrices themselves) is the basin of attraction for the spiral point at (0,1). This region 
is shaded in Figure 9.2.6. 
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FIGURE 9.2.6 Trajectories of the system (14). The basis of attraction 
for the spiral point (0,1) is shaded. 


The basin of attraction for the asymptotically stable node at (—2, —2) consists of the rest of 
the xy-plane, with only a handful of exceptions. The separatrices approach the saddle point, as 
we have noted already, rather than the node. The saddle point itself and the unstable node are 
equilibrium solutions and thus remain fixed for all time. Finally, there is a trajectory lying on 
the line y = —2 for x > 3 on which the direction of motion is always to the right; this trajectory 
also does not approach the point (—2, —2). 
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Figures 9.2.4,9.2.5, and 9.2.6 show that in the immediate vicinity of a critical point, 
the direction field and pattern of trajectories resemble those for a linear system with 
constant coefficients. This becomes even more unmistakable if you use your software 
to zoom in closer and closer to a critical point. Thus we have visual evidence that a 
nonlinear system behaves very much like a linear system, at least in the neighborhood 
of a critical point. We will pursue this idea in the next section. 

Determination of Trajectories. The trajectories of a two-dimensional autonomous system 

dx/dt = F(x,y), dy/dt = G(x,y ) (16) 

can sometimes be found by solving a related first order differential equation. From 
Eqs. (16) we have 

dy _ dy/dt _ G(x,y ) 
dx dx/dt F(x,y )’ 

which is a first order equation in the variables x and y . Observe that such a reduction 
is not usually possible if F and G depend also on t. If Eq. (17) can be solved by any 
of the methods of Chapter 2, and if we write solutions (implicitly) in the form 

H(x,y) = c , (18) 

then Eq. (18) is an equation for the trajectories of the system (16). In other words, the 
trajectories lie on the level curves of H{x,y). Keep in mind that there is no general 
way of solving Eq. (17) to obtain the function H , so this approach is applicable only 
in special cases. 


EXAMPLE 

3 


Find the trajectories of the system 

dx/dt = y, dy/dt = x. 

In this case, Eq. (17) becomes 

dy x 
dx y 

This equation is separable since it can be written as 

y dy = x dx, 


(19) 

( 20 ) 


and its solutions are given by 

H(x,y)=y 2 -x 2 = c, (21) 

where c is arbitrary. Therefore, the trajectories of the system (19) are the hyperbolas shown 
in Figure 9.2.1. The direction of motion on the trajectories can be inferred from the fact that 
both dx/dt and dy dt are positive in the first quadrant. The only critical point is the saddle 
point at the origin. 

Another way to obtain the trajectories is to solve the system (19) by the methods of 
Section 7.5. We omit the details, but the result is 


x = cid + c 2 e 1 , y = C\e l — c 2 e 


Eliminating t between these two equations again leads to Eq. (21). 
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FIGURE 9.2.7 Trajectories of the system (19); the origin is a saddle point. 


EXAMPLE 

4 


Find the trajectories of the system 


dx 

dt 


= 4-2y, 


dy 

dt 


12 - 3x 2 . 


From the equations 


4 — 2y = 0, 12 — 3x 2 = 0 


( 22 ) 


we find that the critical points of the system (22) are the points (—2,2) and (2,2). To 
determine the trajectories, note that for this system, Eq. (17) becomes 


dy 12 — 3x 2 
dx 4 — 2 y ‘ 


(23) 


Separating the variables in Eq. (23) and integrating, we find that solutions satisfy 


H(x,y ) =4y - y 2 - 12x + x 3 = c, 


(24) 


where c is an arbitrary constant. A computer plotting routine is helpful in displaying the 
level curves of H(x,y ), some of which are shown in Figure 9.2.8. The direction of motion 
on the trajectories can be determined by drawing a direction field for the system (22), or 
by evaluating dx/dt and dy/dt at one or two selected points. From Figure 9.2.8 you can 
see that the critical point (2,2) is a saddle point and the point (—2,2) is a center. Observe 
that there is a separatrix (shown in black) that leaves the saddle point (as t -> — oo), loops 
around the center, and returns to the saddle point (as t +oo). Within the separatrix are 
closed trajectories, or periodic solutions, that surround the center. Outside the separatrix, 
trajectories become unbounded, except for the trajectory that enters the saddle point from 
the right. 
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FIGURE 9.2.8 Trajectories of the system (22). The point (—2,2) is a center, 
and the point (2,2) is a saddle point. The black curve is a separatrix. 


PROBLEMS 


In each of Problems 1 through 4, sketch the trajectory corresponding to the solution satisfying 
the specified initial conditions, and indicate the direction of motion for increasing t. 

1. dx/dt = —x, dy/dt = —2y; x(0) = 4, y(0) = 2 

2. dx/dt = -x, dy/dt = 2y; x(0) = 4, y(0) = 2 and x(0) = 4, y(0) = 0 

3. dx/dt = -y, dy/dt = x; x(0) = 4, y(0) = 0 and x(0) = 0, y(0) = 4 

4. dx/dt = ay, dy/dt = —bx, a > 0, b > 0; x(0) = «Ja, y(0) = 0 


For each of the systems in Problems 5 through 16: 

(a) Find all the critical points (equilibrium solutions). 

(b) Use a computer to draw a direction field and phase portrait for the system. 

(c) From the plot(s) in part (b), determine whether each critical point is asymptotically stable, 
stable, or unstable, and classify it as to type. 



(d) 

Describe the basin of attraction for each asymptotically stable critical point. 

4fl 

5. 

dx/dt 

= x — xy, dy/dt 

■ = y + 2xy 

41 

6. 

dx/dt 

= 1 + 2 y, dy/dt 

■ = 1 - 3x 2 

41 

7. 

dx/dt 

1 

(N 

H 

1 

II 

dy/dt = 3 y — 2y 2 — 3 xy 

41 

8. 

dx/dt 

= -(2 +y)(x + y). 

dy/dt = — y(l — x) 

41 

9. 

dx/dt 

II 

fo 

1 

* 

1 

II 

1 

* 

1 

1 

$ 

41 

10. 

dx/dt 

= (2 + x)(y-x), 

dy/dt = y(2 + x - x 2 ) 

41 

11. 

dx/dt 

= — x + 2xy, dy/dt = y — x 2 — y 2 

41 

12. 

dx/dt 

= y, dy/dt = x 

- — x 3 - h 

6 X 5 y 

41 

13. 

dx/dt 

= (2 +x)(y-x). 

dy/dt — (4 - x)(y + x) 

41 

14. 

dx/dt 

= (2 - x)(y - x ), 

II 

Fj 

1 

X 

1 

Ho 

41 

15. 

dx/dt 

II 

* 

fo 

1 

* 

1 

dy/dt = —x + 3 y — 2 xy 

41 

16. 

dx/dt 

II 

* 

fo 

1 

X 

1 

dy/dt = (1 -y)(2 +x) 
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In each of Problems 17 through 24: 

(a) Find an equation of the form H(x,y) = c satisfied by the trajectories. 

(b) Plot several level curves of the function H. These are trajectories of the given system. 
Indicate the direction of motion on each trajectory. 

4fl 17- dx/dt = 2 y, dy/dt — 8x 

^2/ 18- dx/dt = 2 y, dy/dt = —8x 

19. dx/dt = y, dy/dt = 2x + y 

20. dx/dt = — x + y, dy/dt = — x — y 

21. dx/dt = —x + y + x 2 , dy/dt = y — 2xy 

22. dx/dt = 2x 2 y — 3x 2 — 4y, dy/dt — —2xy 2 + 6 xy 
4fl 23. Undamped pendulum: dx/dt = y, dy/dt = — sinx 

24. Duffing’s 2 equations: dx/dt = y, dy/dt = — x + (x 3 /6) 

25. Given that x = 0ft),y = 0ft) is a solution of the autonomous system 

dx/dt = F(x,y ), dy/dt = G(x,y) 

for a < t < p, show that x = 0(7) = 0(7 — s), y = 4*(t) = i/r(t — s) is a solution for 
a + s<t<fi + s for any real number 5. 

26. Prove that for the system 

dx/dt = F(x,y ), dy/dt = G(x,y) 

there is at most one trajectory passing through a given point (xo,yo)- 
Hint: Let C 0 be the trajectory generated by the solution x = 0 o (O, y = 0o(0> with 
0o(f 0 ) — x o, = yo , and let C\ be the trajectory generated by the solution x = 0i(O, 
y = 0ift), with 0ift) = x 0 , 0ift) = yo- Use the fact that the system is autonomous, and 
also the existence and uniqueness theorem, to show that C 0 and C\ are the same. 

27. Prove that if a trajectory starts at a noncritical point of the system 

dx/dt = F(x,y), dy/dt = G(x,y), 

then it cannot reach a critical point (xo,yo) in a finite length of time. 

Hint: Assume the contrary; that is, assume that the solution x = 00), y = 0(0 satisfies 
0ft) = x 0 ,0ft) = y 0 . Then use the fact that x = x 0 ,y = yo is a solution of the given system 
satisfying the initial condition x = xo,y = yo at t = a. 

28. Assuming that the trajectory corresponding to a solution x = 0(0, y = 0(0,— oo < t < oo, 
of an autonomous system is closed, show that the solution is periodic. 

Hint: Since the trajectory is closed, there exists at least one point (x 0 ,yo) such that 
0ft) = xo, 0(0) = yo and a number T > 0 such that 0ft + T) = xo, 0(0 + T) = yo- Show 
thatx = <£>ft) = 0(* + T) andy = 4ft) = 0ft + T) is a solution, and then use the existence 
and uniqueness theorem to show that Oft) = 0ft) and 0(0 = 0ft) for all t. 


2 Georg Duffing (1861-1944), a German engineer, was a pioneer in the study of the oscillations 

of nonlinear mechanical systems. His most important work was the influential monograph Erzwungene 
Schwingungen bei veranderlicher Eigenfrequenz und ihre technische Bedeutung, published in 1918. 
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In Section 9.1 we described the stability properties of the equilibrium solution x = 0 
of the two-dimensional linear system 

x' = Ax. (1) 

The results are summarized in Table 9.1.1. Recall that we required that det A ^ 0, 
so x = 0 is the only critical point of the system (1). Now that we have defined the 
concepts of asymptotic stability, stability, and instability more precisely, we can restate 
these results in the following theorem. 


Theorem 9.3.1 Th e cr iti ca l point X = 0 of the linear system (1) is asymptotically stable if the eigen¬ 
values r \, r 2 are real and negative or have negative real part; is stable, but not 
asymptotically stable, if r\ and r 2 are pure imaginary; and is unstable if r\ and r 2 are 
real and either is positive, or if they have positive real part. 


Effect of Small Perturbations. It is apparent from this theorem or from Table 9.1.1 that 
the eigenvalues r\ , r 2 of the coefficient matrix A determine the type of critical point 
at x = 0 and its stability characteristics. In turn, the values of r\ and r 2 depend on 
the coefficients in the system (1). When such a system arises in some applied field, the 
coefficients usually result from the measurements of certain physical quantities. Such 
measurements are often subject to small uncertainties, so it is of interest to investigate 
whether small changes (perturbations) in the coefficients can affect the stability or 
instability of a critical point and/or significantly alter the pattern of trajectories. 

Recall that the eigenvalues r \, r 2 are the roots of the polynomial equation 

det(A - rl) = 0. (2) 

It is possible to show that small perturbations in some or all the coefficients are 
reflected in small perturbations in the eigenvalues. The most sensitive situation 
occurs when r\ = ifi and r 2 = —i/i. Then the critical point is a center and the tra¬ 
jectories are closed curves (ellipses) surrounding it. If a slight change is made in the 
coefficients, then the eigenvalues r\ and r 2 will take on new values r[ = X' + i/i' and 
r' 2 = X' — ifi ', where X' is small in magnitude and /T = /x (see Figure 9.3.1). If X' ^ 0, 
which almost always occurs, then the trajectories of the perturbed system are spi¬ 
rals rather than ellipses. The system is asymptotically stable if X' < 0 but unstable if 
X' > 0. Thus, in the case of a center, small perturbations in the coefficients may well 
change a stable system into an unstable one and, in any case, may be expected to 
change the trajectories from ellipses to spirals (see Problem 27). 

Another slightly less sensitive case occurs if the eigenvalues r\ and r 2 are equal; in 
this case the critical point is a node. Small perturbations in the coefficients will nor¬ 
mally cause the two equal roots to separate (bifurcate). If the separated roots are real, 
then the critical point of the perturbed system remains a node, but if the separated 
roots are complex conjugates, then the critical point becomes a spiral point. These 
two possibilities are shown schematically in Figure 9.3.2. In this case the stability or 
instability of the system is not affected by small perturbations in the coefficients, but 
the type of the critical point may be changed (see Problem 28). 
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FIGURE 9.3.1 Schematic perturbation of r\ = ipu, r 2 = —i/i. 


A* 




n=r 2 

-x-—0 — ^O- 
r i r 2 


X r{ = A + ip 




r l =r 2 


O r 2 = h-ifi 
FIGURE 9.3.2 Schematic perturbation of r x — r 2 . 


In all other cases the stability or instability of the system is not changed, nor is the 
type of critical point altered, by sufficiently small perturbations in the coefficients 
of the system. For example, if r\ and r 2 are real, negative, and unequal, then a small 
change in the coefficients will neither change the sign of r\ and r 2 nor allow them to 
coalesce. Thus the critical point remains an asymptotically stable node. 

Linear Approximations to Nonlinear Systems. Now let us consider a nonlinear autonomous 
two-dimensional system 

x' = f(x). (3) 

Our main object is to investigate the behavior of trajectories of the system (3) near a 
critical point x°. Recall that in Example 1 in Section 9.2 we noted that near each critical 
point of that nonlinear system the pattern of trajectories resembles the trajectories 
of a certain linear system. This suggests that near a critical point we may be able 
to approximate the nonlinear system (3) by an appropriate linear system, whose 
trajectories are easy to describe. The crucial question is whether and how we can 
find an approximating linear system whose trajectories closely match those of the 
nonlinear system near the critical point 

It is convenient to choose the critical point to be the origin. This involves no loss 
of generality, since if x° ^ 0, it is always possible to make the substitution u = x — x° 
in Eq. (3). Then u will satisfy an autonomous system with a critical point at the origin. 

First, let us consider what it means for a nonlinear system (3) to be “close” to a 
linear system (1). Accordingly, suppose that 

x'=Ax + g(x) (4) 

and that x = 0 is an isolated critical point of the system (4). This means that there 
is some circle about the origin within which there are no other critical points. In 
addition, we assume that det A ^ 0, so that x = 0 is also an isolated critical point 
of the linear system x' = Ax. For the nonlinear system (4) to be close to the linear 
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EXAMPLE 
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system x' = Ax, we must assume that g(x) is small. More precisely, we assume that 
the components of g have continuous first partial derivatives and satisfy the limit 
condition 

llg(x)||/||x|| 0 as x^O; (5) 

that is, ||g|| is small in comparison to ||x|| itself near the origin. Such a system is called 
a locally linear system in the neighborhood of the critical point x = 0. 

It may be helpful to express the condition (5) in scalar form. If we let 
\ T = (x,y), then ||x|| = (x 2 + y 2 ) 1/2 = r. Similarly, if g r (x) = (gi(x,y), g 2 (x,y)), 
then ||g(x)|| = \g\(x,y) + g\(x,y)] 1/2 . Then it follows that condition (5) is satisfied if 
and only if 

gi(x,y)/r^0, g 2 (x,y)/r 0 as r -* 0. (6) 


Determine whether the system 





/ -x 2 -xy \ 
y—0.75xy - 0.25/i 


(7) 


is locally linear in the neighborhood of the origin. 

Observe that the system (7) is of the form (4), that (0,0) is a critical point, and that 
det A 7 ^ 0. It is not hard to show that the other critical points of Eqs. (7) are (0, 2), (1, 0), 
and (0.5, 0.5); consequently, the origin is an isolated critical point. In checking the condition 
( 6 ), it is convenient to introduce polar coordinates by letting x = r cos 0,y = r sin 0. Then 

gi (x, y ) — x 2 — xy —r 2 cos 2 0 — r 2 sin 0 cos 0 

r r r 

= —r( cos 2 0 + sin 0 cos 0) -> 0 


as r 0. In a similar way you can show that g 2 (x,y)/r 0 as r -> 0. Hence the system (7) is 

locally linear near the origin. 


The motion of a pendulum is described by the system [see Eq. (13) of Section 9.2] 

dx dy 2 . 

di =y ’ di = ~ Msm x - yy - (8) 

The critical points are (0, 0), (±tt, 0), (±27 t, 0),..., so the origin is an isolated critical point of 
this system. Show that the system is locally linear near the origin. 

To compare Eqs. ( 8 ) with Eq. (4), we must rewrite the former so that the linear and nonlinear 
terms are clearly identified. If we write sin* = x + (sinx — x) and substitute this expression in 
the second of Eqs. ( 8 ), we obtain the equivalent system 



On comparing Eq. (9) and Eq. (4), we see that g\(x,y) = 0 and g 2 (x,y) = —co 2 (sinx — x). 
From the Taylor series for sin x, we know that sinx — x behaves like —x 3 /3! = — (r 3 cos 3 0)/ 3! 
when x is small. Consequently, (sinx — x)/r -> 0 as r 0. Thus the conditions ( 6 ) are 
satisfied, and the system (9) is locally linear near the origin. 
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Let us now return to the general nonlinear system (3), which we write in the scalar 
form 

x! = F(x,y\ y' = G(x,y); (10) 

that is, x = ( x,y) T and f(x) = ( F(x,y ), G(x,y)) T . The system (10) is locally linear in 
the neighborhood of a critical point (jco,yo) whenever the functions F and G have 
continuous partial derivatives up to order two. To show this, we use Taylor expansions 
about the point (xo,yo) to write F(x,y ) and G(x,y) in the form 


F(x,y) = F(x 0 ,y o) + F x (x 0 ,yo)(x - x 0 ) + F y (x 0 ,yo)(y - yo) + mfcy), 


G(x,y) = G(x 0 ,yo) + G x (x 0 ,y 0 )(x - x 0 ) + G y (x 0 ,yo)(y - yo) + m(x,y)> 

where rn(x,y)/[(x - x 0 ) 2 + (y - yo) 2 ] 1/2 -> 0 as (x,y) -> (. xo,yo ), and similarly for 
r\ 2 . Note that T(xo,yo) = G(xo,yo) = 0, and that dx/dt = d(x — xo)/dt and 
dy/dt = d(y — yo)/dt. Then the system (10) reduces to 


d /x — xo 
dt \y - yo 

or, in vector notation, 


' F x (x 0 ,y 0 ) 
K G x (x 0 ,yo) 


Fy(X 0 
G y (x o 


,y 0 )\ (m (x,y)\ 

,yo)J\y-yo) \m(x 9 y)J' { J 


du di a 

~77 = - r (x u )u + /y(x), 

dt dx 


( 12 ) 


where u = (x-xo,y- yo) T and rj = (rn, r} 2 ) T - 
The significance of this result is twofold. First, if the functions F and G are twice 
differentiable, then the system (10) is locally linear, and it is unnecessary to resort 
to the limiting process used in Examples 1 and 2. Second, the linear system that 
approximates the nonlinear system (10) near (xo,yo) gi yen by the linear part of 
Eqs. (11) or (12): 


d_ f u i\ _ ( F x (x 0 ,yo ) F y (x 0 ,yo)\ (u\ 
dt \u 2 ) \G x (x 0 ,yo) G y (x 0 ,yo)J W 


(13) 


where u\ = x — xq and u 2 —y — yo- Equation (13) provides a simple and general 
method for finding the linear system corresponding to a locally linear system near a 
given critical point. 

The matrix 


J = 




(14) 


which appears as the coefficient matrix in Eq. (13), is called the Jacobian 3 matrix 
of the functions F and G with respect to x and y. We need to assume that det(J) is 
not zero at (%o,yo) so that this point is also an isolated critical point of the linear 
system (13). 


3 Carl Gustav Jacob Jacobi (1804-1851), a German analyst who was professor and lecturer at the Uni¬ 
versities of Konigsberg and Berlin, made important contributions to the theory of elliptic functions. The 
determinant of J and its extension to n functions of n variables is called the Jacobian because of his notable 
paper in 1841 on the properties of this determinant. The corresponding matrix is also named for Jacobi, 
even though matrices were not developed until after his death. 
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Theorem 9.3.2 


Use Eq. (13) to find the linear system corresponding to the pendulum equations ( 8 ) near the 
origin; near the critical point (tt, 0 ). 

In this case we have, from Eq. ( 8 ), 

F(x,y ) = y, G(x,y) = —a? sinx — yy; (15) 

since these functions are differentiable as many times as necessary, the system ( 8 ) is locally 
linear near each critical point. The derivatives of F and G are 

F x = 0, F y — 1, G x = —co 2 cosx, G y = —y. (16) 


Thus, at the origin the corresponding linear system is 


dt \y 




(17) 


which agrees with Eq. (9). 

Similarly, evaluating the partial derivatives in Eq. (16) at (tt, 0), we obtain 


d_ 

dt 




(18) 


where u = x — tt, v = y. This is the linear system corresponding to Eqs. ( 8 ) near the point (tt, 0). 


We now return to the locally linear system (4). Since the nonlinear term g(x) is 
small compared to the linear term Ax when x is small, it is reasonable to hope that 
the trajectories of the linear system (1) are good approximations to those of the 
nonlinear system (4), at least near the origin. This turns out to be true in many (but 
not all) cases, as the following theorem states. 

Let r\ and r 2 be the eigenvalues of the linear system (1) corresponding to 
the locally linear system (4). Then the type and stability of the critical point 
(0, 0) of the linear system (1) and the locally linear system (4) are as shown in 
Table 9.3.1. 


TABLE 9.3.1 Stability and Instability Properties of Linear and Locally Linear Systems 




Linear System 

Locally Linear System 

r\ ,r 2 

Type 

Stability 

Type 

Stability 

r\ > r 2 > 0 

N 

Unstable 

N 

Unstable 

r\ < r 2 < 0 

N 

Asymptotically 

stable 

N 

Asymptotically 

stable 

r 2 < 0 < r\ 

SP 

Unstable 

SP 

Unstable 

n = r 2 > 0 

PN or IN 

Unstable 

N or SpP 

Unstable 

n = r 2 < 0 

r\, r 2 — X ± i[i 

PN or IN 

Asymptotically 

stable 

N or SpP 

Asymptotically 

stable 

X > 0 

SpP 

Unstable 

SpP 

Unstable 

X < 0 

SpP 

Asymptotically 

stable 

SpP 

Asymptotically 

stable 

II 

?’ 

to* 

II 

1 

■£' 

C 

Stable 

C or SpP 

Indeterminate 


Note: N, node; IN, improper node; PN, proper node; SP, saddle point; SpP, spiral point; 
C, center. 
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At this stage, the proof of Theorem 9.3.2 is too difficult to give, so we will accept 
the results without proof. The statements for asymptotic stability and instability 
follow as a consequence of a result discussed in Section 9.6, and a proof is sketched in 
Problems 10 to 12 of that section. Essentially, Theorem 9.3.2 says that for small x (or 
x — x°) the nonlinear terms are also small and do not affect the stability and type of 
critical point as determined by the linear terms, except in two sensitive cases. If r\ and 
r 2 are pure imaginary, then the small nonlinear terms may change the stable center 
into a spiral point, which may be either asymptotically stable or unstable. If r\ and r 2 
are real and equal, then the nonlinear terms may change the node into a spiral point, 
but its asymptotic stability or instability remains unchanged. Recall that earlier in 
this section we stated that small perturbations in the coefficients of the linear system 
(1), and hence in the eigenvalues r\ and r 2 , can alter the type and stability of the crit¬ 
ical point only in these two cases. It is reasonable to expect that the small nonlinear 
term in Eq. (4) might have a similar substantial effect, at least in these two cases. This 
is so, but the main significance of Theorem 9.3.2 is that in all other cases the small 
nonlinear term does not alter the type or stability of the critical point. Thus, except 
in the two sensitive cases, the type and stability of the critical point of the nonlinear 
system (4) can be determined from a study of the much simpler linear system (1). 

Even if the critical point is of the same type as that of the linear system, the 
trajectories of the locally linear system may be considerably different in appearance 
from those of the corresponding linear system, except very near the critical point. 
However, it can be shown that the slopes at which trajectories “enter” or “leave” the 
critical point are given correctly by the linear system. 

Damped Pendulum. We continue the discussion of the damped pendulum begun in 
Examples 2 and 3. Near the origin the nonlinear equations (8) are approximated 
by the linear system (17), whose eigenvalues are 


—y =b Jy 2 — 4 co 2 
n ,r 2 =--- 


(19) 


The nature of the solutions of Eqs. (8) and (17) depends on the sign of y 2 — 4co 2 as 
follows: 


1. If y 2 — 4 co 2 > 0, then the eigenvalues are real, unequal, and negative. The critical point 
(0,0) is an asymptotically stable node of the linear system (17) and of the locally linear 
system (8). 

2. If y 2 — 4co 2 = 0, then the eigenvalues are real, equal, and negative. The critical point (0,0) 
is an asymptotically stable (proper or improper) node of the linear system (17). It may be 
either an asymptotically stable node or spiral point of the locally linear system (8). 

3. If y 2 — 4(o 2 < 0, then the eigenvalues are complex with negative real part. The critical 
point (0,0) is an asymptotically stable spiral point of the linear system (17) and of the 
locally linear system (8). 

Thus the critical point (0,0) is a spiral point of the system (8) if the damping is small 
and a node if the damping is large enough. In either case, the origin is asymptotically 
stable. 

Let us now consider the case y 2 — 4co 2 < 0, corresponding to small damping, in 
more detail. The direction of motion on the spirals near (0,0) can be obtained directly 
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from Eqs. (8). Consider the point at which a spiral intersects the positive y-axis (x = 0 
and y > 0). It follows from Eqs. (8) that at such a point, dx/dt > 0. Thus the point 
(. x,y ) on the trajectory is moving to the right, so the direction of motion on the spirals 
is clockwise. 

The behavior of the pendulum near the critical points (±mr,0), with n even, is 
the same as its behavior near the origin. We expect this on physical grounds since 
all these critical points correspond to the downward equilibrium position of the 
pendulum. The conclusion can be confirmed by repeating the analysis carried out 
above for the origin. Figure 9.3.3 shows the clockwise spirals at a few of these critical 
points. 



FIGURE 9.3.3 Asymptotically stable spiral points for the damped pendulum. 


Now let us consider the critical point (tt, 0). Here the nonlinear equations (8) are 
approximated by the linear system (18), whose eigenvalues are 


—y zb Jy 2 + 4 co 2 

ri ,r 2 = --- 


( 20 ) 


One eigenvalue (r{) is positive and the other ( 7 * 2 ) is negative. Therefore, regardless 
of the amount of damping, the critical point x = tt, y = 0 is an unstable saddle point 
both of the linear system (18) and of the locally linear system (8). 

To examine the behavior of trajectories near the saddle point (tt, 0) in more detail, 
we write down the general solution of Eqs. (18), namely, 



Ci 



+ c 2 



( 21 ) 


where C\ and C 2 are arbitrary constants. Since r\ > 0 and r 2 < 0, it follows that the 
solution that approaches zero as t -> 00 corresponds to Ci = 0. For this solution 
v/u = r 2 , so the slope of the entering trajectories is negative; one lies in the second 
quadrant (C 2 < 0), and the other lies in the fourth quadrant (C 2 > 0). For C 2 = 0 
we obtain the pair of trajectories “exiting” from the saddle point. These trajectories 
have slope r\ > 0; one lies in the first quadrant (Ci > 0), and the other lies in the 
third quadrant (Ci < 0). 

The situation is the same at other critical points (mr,0) with n odd. These all 
correspond to the upward equilibrium position of the pendulum, so we expect them 
to be unstable. The analysis at (tt, 0) can be repeated to show that they are saddle 
points oriented in the same way as the one at (n, 0). Diagrams of the trajectories in 
the neighborhood of two saddle points are shown in Figure 9.3.4. 
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FIGURE 9.3.4 Unstable saddle points for the damped pendulum. 


EXAMPLE 

4 


The equations of motion of a certain pendulum are 

dx/dt = y, dy/dt = —9sinx — \y, (22) 

where x = 0 and y = dO/dt. Draw a phase portrait for this system, and explain how it shows 
the possible motions of the pendulum. 

By plotting the trajectories starting at various initial points in the phase plane, we obtain 
the phase portrait shown in Figure 9.3.5. As we have seen, the critical points (equilibrium 
solutions) are the points (wr, 0), where n = 0, ±1, ± 2,.... Even values of n , including zero, 
correspond to the downward position of the pendulum, while odd values of n correspond to 
the upward position. Near each of the asymptotically stable critical points, the trajectories 
are clockwise spirals that represent a decaying oscillation about the downward equilibrium 
position. The wavy horizontal portions of the trajectories that occur for larger values of |y| 
represent whirling motions of the pendulum. Note that a whirling motion cannot continue 
indefinitely, no matter how large |y| is; eventually, the angular velocity is so much reduced by 
the damping term that the pendulum can no longer go over the top and, instead, begins to 
oscillate about its downward position. 



FIGURE 9.3.5 Phase portrait for the damped pendulum of Example 4. 


The basin of attraction for the origin is the shaded region in Figure 9.3.5. It is bounded by 
the trajectories that enter the two adjacent saddle points at (7r,0) and (—7r,0). The bound¬ 
ing trajectories are separatrices. Each asymptotically stable critical point has its own basin of 
attraction, which is bounded by the separatrices entering the two neighboring saddle points. 
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All of the basins of attraction are congruent to the shaded one; the only difference is that 
they are translated horizontally by appropriate distances. Note that it is mathematically pos¬ 
sible (but physically unrealizable) to choose initial conditions exactly on a separatrix so that 
the resulting motion leads to a balanced pendulum in a vertically upward position of unstable 
equilibrium. 


An important difference between nonlinear autonomous systems and the linear 
systems discussed in Section 9.1 is illustrated by the pendulum equations. Recall that 
the linear system (1) has only the single critical point x = 0 if det A ^ 0. Thus, if 
the origin is asymptotically stable, then not only do trajectories that start close to the 
origin approach it, but, in fact, every trajectory approaches the origin. In this case 
the critical point x = 0 is said to be globally asymptotically stable. This property of 
linear systems is not, in general, true for nonlinear systems, even if the nonlinear 
system has only one asymptotically stable critical point. Therefore, for nonlinear 
systems, it is important to determine (or to estimate) the basin of attraction for each 
asymptotically stable critical point. 


PROBLEMS In each of Problems 1 through 4, verify that (0,0) is a critical point, show that the system is 
locally linear, and discuss the type and stability of the critical point (0,0) by examining the 
corresponding linear system. 

1. dx/dt = x — y 2 , dy/dt = x — 2y + x 2 

2. dx/dt = — x + y + 2xy, dy/dt = —Ax — y + x 2 — y 2 

3. dx/dt = (1 + x) siny, dy/dt = 1 — x — cosy 

4. dx/dt = x -by 2 , dy/dt = x + y 

In each of Problems 5 through 18: 

(a) Determine all critical points of the given system of equations. 

(b) Find the corresponding linear system near each critical point. 

(c) Find the eigenvalues of each linear system. What conclusions can you then draw about 
the nonlinear system? 

(d) Draw a phase portrait of the nonlinear system to confirm your conclusions, or to extend 
them in those cases where the linear system does not provide definite information about the 
nonlinear system. 

5. dx/dt = (2 + x)(y — x), dy/dt = (4 — x)(y + x) 

6. dx/dt = x — x 2 — xy, dy/dt = 3y — xy — 2y 2 

7. dx/dt — 1 — y, dy/dt = x 2 — y 2 

8. dx/dt = x — x 2 — xy, dy/dt = |y — \y 2 — | xy 

9. dx/dt = (2 + y)(y — 0.5x), dy/dt = (2 — x)(y + 0.5x) 

^2/ 10- dx/dt = x + x 2 + y 2 , dy/dt = y — xy 

11. dx/dt = 2 x + y + xy 3 , dy/dt = x — 2y — xy 
ff2/ 12. dx/dt = (1 + x) siny, dy/dt = 1 — x — cosy 
^2/ 13. dx/dt—x — y 2 , dy/dt —y — x 2 

14. dx/dt = 1 — xy, dy/dt = x — y 3 

15. dx/dt = —2x - y - x(x 2 + y 2 ), dy/dt = x - y + y(x 2 + y 2 ) 

^2/ 16. dx/dt = y + x(l — x 2 — y 2 ), dy/dt = — x + y(l — x 2 — y 2 ) 
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17. dx/dt = 4 - y 2 , dy/dt = (1.5 + x)(y - x) 

^2/ 18- dx/dt = (1 - y)(2x - y), dy/dt = (2 + x)(x — 2y) 

19. Consider the autonomous system 

dx/dt — y, dy/dt = x + 2x 3 . 

(a) Show that the critical point (0,0) is a saddle point. 

(b) Sketch the trajectories for the corresponding linear system by integrating the equation 
for dy/dx. Show from the parametric form of the solution that the only trajectory on which 
x ^ 0, y ^ 0 as t ^ oo is y = —x. 

(c) Determine the trajectories for the nonlinear system by integrating the equation for 
dy/dx. Sketch the trajectories for the nonlinear system that correspond to y = — x and 
y = x for the linear system. 

20. Consider the autonomous system 

dx/dt = x, dy/dt = —2y + x 3 . 

(a) Show that the critical point (0,0) is a saddle point. 

(b) Sketch the trajectories for the corresponding linear system, and show that the 
trajectory for which x 0, y 0 as t oo is given by x = 0. 

(c) Determine the trajectories for the nonlinear system for x ^ 0 by integrating the equa¬ 
tion for dy/dx. Show that the trajectory corresponding to x = 0 for the linear system is 
unaltered, but that the one corresponding to y = 0 is y = x 3 /5. Sketch several of the 
trajectories for the nonlinear system. 

21. The equation of motion of an undamped pendulum is d 2 0/dt 2 + co 2 sin 6 = 0, where 
co 2 = g/L. Let x = 0,y = dO/dt to obtain the system of equations 

dx/dt = y, dy/dt = —co 2 sinx. 

(a) Show that the critical points are (±mr, 0), n = 0,1,2,..., and that the system is locally 
linear in the neighborhood of each critical point. 

(b) Show that the critical point (0, 0) is a (stable) center of the corresponding linear 
system. Using Theorem 9.3.2, what can you say about the nonlinear system? The 
situation is similar at the critical points (±2«7 t, 0), n = 1,2,3,.... What is the physical 
interpretation of these critical points? 

(c) Show that the critical point (tt, 0) is an (unstable) saddle point of the correspond¬ 
ing linear system. What conclusion can you draw about the nonlinear system? The 

situation is similar at the critical points [±(2 n — 1)jt , 0], n = 1,2,3,_What is the physical 

interpretation of these critical points? 

(d) Choose a value for co 2 and plot a few trajectories of the nonlinear system in the 
neighborhood of the origin. Can you now draw any further conclusion about the nature 
of the critical point at (0,0) for the nonlinear system? 

(e) Using the value of co 2 from part (d), draw a phase portrait for the pendulum. Compare 
your plot with Figure 9.3.5 for the damped pendulum. 

22. (a) By solving the equation for dy/dx , show that the equation of the trajectories of the 
undamped pendulum of Problem 21 can be written as 

\y 2 + co 2 (l — cosx) = c, (i) 


where c is a constant of integration. 
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(b) Multiply Eq. (i) by mL 2 . Then express the result in terms of 0 to obtain 



2 


+ mgL{l — cos 6) = £, 


(ii) 


where E = mL 2 c. 

(c) Show that the first term in Eq. (ii) is the kinetic energy of the pendulum and that 
the second term is the potential energy due to gravity. Thus the total energy E of the 
pendulum is constant along any trajectory; its value is determined by the initial conditions. 


41 23. The motion of a certain undamped pendulum is described by the equations 

dx/dt — y, dy/dt = —4sinx. 


If the pendulum is set in motion with an angular displacement A and no initial velocity, 
then the initial conditions are x(0) = A,y( 0) = 0. 

(a) Let A = 0.25 and plot x versus t. From the graph, estimate the amplitude R and 
period T of the resulting motion of the pendulum. 

(b) Repeat part (a) for A = 0.5,1.0,1.5, and 2.0. 

(c) How do the amplitude and period of the pendulum’s motion depend on the initial 
position A? Draw a graph to show each of these relationships. Can you say anything about 
the limiting value of the period as A —> 0? 

(d) Let A = 4 and plot x versus t. Explain why this graph differs from those in parts (a) 
and (b). For what value of A does the transition take place? 

24. Consider again the pendulum equations (see Problem 23) 


dx/dt = y, dy/dt = —4sinx. 


If the pendulum is set in motion from its downward equilibrium position with angular 
velocity v, then the initial conditions are x(0) = 0,y(0) = v. 

(a) Plot x versus t for v = 2 and also for v = 5. Explain the differing motions of the 
pendulum that these two graphs represent. 

(b) There is a critical value of a, which we denote by v c , such that one type of motion 
occurs for v < v c and the other for v > v c . Estimate the value of v c . 

4E 25. This problem extends Problem 24 to a damped pendulum. The equations of motion are 


dx/dt = y, dy/dt = —4 sinx — yy, 


where y is the damping coefficient, with the initial conditions x(0) = 0,y(0) = v. 

(a) For y = 1/4, plot x versus t for v = 2 and for v = 5. Explain these plots in terms of 
the motions of the pendulum that they represent. Also explain how they are related to the 
corresponding graphs in Problem 24(a). 

(b) Estimate the critical value v c of the initial velocity where the transition from one type 
of motion to the other occurs. 

(c) Repeat part (b) for other values of y and determine how v c depends on y. 

26. Theorem 9.3.2 provides no information about the stability of a critical point of a locally 
linear system if that point is a center of the corresponding linear system. That this must 
be the case is illustrated by the systems 


dx/dt = y + x(x 2 + y 2 ), 
dy/dt = -x + y(x 2 + y 2 ) 


(i) 
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and 


dx/dt = y — x(x 2 + y 2 ), 
dy/dt = -x - y(x 2 + y 2 ). 


(a) Show that (0,0) is a critical point of each system and, furthermore, is a center of the 
corresponding linear system. 

(b) Show that each system is locally linear. 

(c) Let r 2 = x 2 + y 2 , and note that x dx/dt + y dy/dt = r dr/dt. For system (ii), show that 
dr/dt < 0 and that r -> 0 as t -> oo; hence the critical point is asymptotically stable. For 
system (i), show that the solution of the initial value problem for r with r = r 0 at t = 0 
becomes unbounded as t -> 1/2r^, and hence the critical point is unstable. 

27. In this problem we show how small changes in the coefficients of a system of linear 
equations can affect a critical point that is a center. Consider the system 



Show that the eigenvalues are ±i so that (0,0) is a center. Now consider the system 



where |e| is arbitrarily small. Show that the eigenvalues are e ± i. Thus no matter how 
small \e\ 7^ 0 is, the center becomes a spiral point. If e < 0, the spiral point is asymptotically 
stable; if e > 0, the spiral point is unstable. 

28. In this problem we show how small changes in the coefficients of a system of linear equa¬ 
tions can affect the nature of a critical point when the eigenvalues are equal. Consider the 
system 



Show that the eigenvalues are r\ — — 1, r 2 = — 1 so that the critical point (0,0) is an 
asymptotically stable node. Now consider the system 



where \e\ is arbitrarily small. Show that if e > 0, then the eigenvalues are —1 ± iy/e, 
so that the asymptotically stable node becomes an asymptotically stable spiral point. 
If e < 0, then the roots are — 1 dfc \/M, and the critical point remains an asymptotically 
stable node. 

4fl 29. In this problem we derive a formula for the natural period of an undamped nonlinear 
pendulum [c = 0 in Eq. (10) of Section 9.2]. Suppose that the bob is pulled through a 
positive angle a and then released with zero velocity. 

(a) We usually think of 0 and d0/dt as functions of t. However, if we reverse the roles of 
t and 0, we can regard t as a function of 0 and, consequently, can also think of d0/dt as a 
function of 0. Then derive the following sequence of equations: 



dO 

dt 


= —mgL sin 0 , 
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L dO 


'P g 


2g Vcos 0 — cos a 


Why was the negative square root chosen in the last equation? 

(b) If T is the natural period of oscillation, derive the formula 



(c) By using the identities cos 0 = 1 — 2 sin 2 (0/2) and cos a = 1 — 2 sin 2 (a/2), followed by 
the change of variable sin (0/2) = k sin 0 with k = sin(a/2), show that 



The integral is called the elliptic integral of the first kind. Note that the period depends 
on the ratio L/g and also on the initial displacement a through k = sin (a/2). 

(d) By evaluating the integral in the expression for T, obtain values for T that you can 
compare with the graphical estimates you obtained in Problem 23. 

30. A generalization of the damped pendulum equation discussed in the text, or a damped 
spring-mass system, is the Lienard 4 equation 


—+ c (x) - +g(x) = 0 . 


If c(x) is a constant and g(x) = kx , then this equation has the form of the linear pen¬ 
dulum equation [replace sin 0 with 0 in Eq. (12) of Section 9.2]; otherwise, the damping 
force c(x) dx/dt and the restoring force g(x) are nonlinear. Assume that c is continuously 
differentiable, g is twice continuously differentiable, and g(0) = 0. 

(a) Write the Lienard equation as a system of two first order equations by introducing 
the variable y = dx/dt. 

(b) Show that (0,0) is a critical point and that the system is locally linear in the 
neighborhood of (0,0). 

(c) Show that if c(0) >0 and g'(0) > 0, then the critical point is asymptotically stable, and 
that if c(0) < 0 or g'(0) < 0, then the critical point is unstable. 

Hint: Use Taylor series to approximate c and g in the neighborhood of x = 0. 


9.4 Competing Species 


In this section and the next, we explore the application of phase plane analysis to 
some problems in population dynamics. These problems involve two interacting 
populations and are extensions of those discussed in Section 2.5, which dealt with 


4 Alfred-Marie Lienard (1869-1958), a French physicist and engineer, was professor at l’Ecole des Mines 
in Paris. He worked primarily in electricity, mechanics, and applied mathematics. The results of his 
investigation of this differential equation were published in 1928. 
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EXAMPLE 

1 

a single population. Although the equations discussed here are extremely simple 
compared to the very complex relationships that exist in nature, it is still possible to 
acquire some insight into ecological principles from a study of these model problems. 
The same, or similar, models have also been used to study other types of competitive 
situations—for instance, businesses competing in the same market. 

Suppose that in some closed environment there are two similar species competing 
for a limited food supply—for example, two species of fish in a pond that do not prey 
on each other but do compete for the available food. Letx and y be the populations of 
the two species at time t. As discussed in Section 2.5, we assume that the population 
of each of the species, in the absence of the other, is governed by a logistic equation. 
Thus 

dx/dt = x(Ti — orix), (la) 

dy/dt = y{e 2 - a 2 y), (lb) 

respectively, where e\ and e 2 are the growth rates of the two populations, and /o\ 
and € 2/02 are their saturation levels. However, when both species are present, each 
will tend to diminish the available food supply for the other. In effect, they reduce 
each other’s growth rates and saturation populations. The simplest expression for 
reducing the growth rate of species x due to the presence of species y is to replace the 
growth rate factor €\ — o\x in Eq. (la) by — o\x — oqy, where oq is a measure of 
the degree to which species y interferes with species x. Similarly, in Eq. (lb) we replace 
62 — by 62 — a 2 y — ol 2 x. Thus we have the system of equations 

dx/dt = x{€\ — o\x — y), 

dy/dt = y(e 2 - o 2 y - a 2 x). 

The values of the positive constants ei, o\, ai, 62, and a 2 depend on the particular 
species under consideration and in general must be determined from observations. 
We are interested in solutions of Eqs. (2) for which x and y are nonnegative. In the 
following two examples we discuss two typical problems in some detail. At the end 
of the section we return to the general equations (2). 

Discuss the qualitative behavior of solutions of the system 

dx/dt = x(l — x — y), 

(3) 

dy/dt = y(0.75 — y — 0.5x). 

We find the critical points by solving the system of algebraic equations 

x(l — x — y) — 0, y(0.75 — y — 0.5x) = 0. (4) 

The first equation can be satisfied by choosing x = 0; then the second equation requires that 
y = 0ory = 0.75. Similarly, the second equation can be satisfied by choosing y = 0, and then 
the first equation requires that x = 0 or x = 1. Thus we have found three critical points, namely, 
(0,0), (0,0.75), and (1,0). If neither x nor y is zero, then Eqs. (4) are also satisfied by solutions 
of the system 

1 - x - y = 0, 0.75 - y - 0.5x = 0, (5) 

which leads to a fourth critical point (0.5,0.5). These four critical points correspond to equi¬ 
librium solutions of the system (3). The first three of these points involve the absence of one 
or both species; only the last corresponds to the presence of both species. Other solutions 
are represented as curves or trajectories in the xy-plane that describe the evolution of the 
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populations in time. To begin to discover their qualitative behavior, we can proceed in the 
following way. 

First, observe that the coordinate axes are themselves trajectories. This follows directly 
from Eqs. (3) since dx/dt = 0 on the y-axis (where x = 0) and, similarly, dy/dt = 0 on the 
x-axis (where y = 0). Thus no other trajectories can cross the coordinate axes. For a popu¬ 
lation problem only nonnegative values of x and y are significant, and we conclude that any 
trajectory that starts in the first quadrant remains there for all time. 

A direction field for the system (3) in the positive quadrant is shown in Figure 9.4.1; the 
black dots in this figure are the critical points or equilibrium solutions. Based on the direction 
field, it appears that the point (0.5,0.5) attracts other solutions and is therefore asymptotically 
stable, while the other three critical points are unstable. To confirm these conclusions, we can 
look at the linear approximations near each critical point. 
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FIGURE 9.4.1 Critical points and direction field for the system (3). 


The system (3) is locally linear in the neighborhood of each critical point. There are two 
ways to obtain the linear system near a critical point (X, Y). First, we can use the substitution 
x = X + u,y = Y + v in Eqs. (3), retaining only the terms that are linear in u and v. Alter¬ 
natively, we can evaluate the Jacobian matrix J at each critical point to obtain the coefficient 
matrix in the approximating linear system; see Eq. (13) in Section 9.3. When several critical 
points are to be investigated, it is usually better to use the Jacobian matrix. For the system (3), 
we have 


F(x,y) = x(l — x — y), G(x,y) = y(0.75 - y - 0.5x), 


( 6 ) 


SO 


( 1 — 2 x — y —x 

—0.5y 0.75 - 2y - 0.5x 


(7) 


We will now examine each critical point in turn. 
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x = 0,y = 0 . This critical point corresponds to the state in which neither species is present. 
To determine what happens near the origin we can set x = y = 0 in Eq. (7), which leads to the 
corresponding linear system 


d 

dt 




( 8 ) 


The eigenvalues and eigenvectors of the system (8) are 


ri = l, 



r 2 = 0.75, 



(9) 


so the general solution of the system is 



( 10 ) 


Thus the origin is an unstable node of both the linear system (8) and the nonlinear system 
(3). In the neighborhood of the origin, all trajectories are tangent to the y-axis except for one 
trajectory that lies along the x-axis. If either or both of the species are present in small numbers, 
the population(s) will grow. 


x = 1 , y = 0 . This corresponds to a state in which species x is present but species y is not. 
By evaluating J from Eq. (7) at (1,0), we find that the corresponding linear system is 


d 

dt 




Its eigenvalues and eigenvectors are 


ri = -1, 



r 2 = 0.25, 



and its general solution is 



= ci 



e 1 + c 2 



e *25t 


(li) 


( 12 ) 


(13) 


Since the eigenvalues have opposite signs, the point (1,0) is a saddle point, and so it is an unsta¬ 
ble equilibrium point of the linear system (11) and of the nonlinear system (3). The behavior 
of the trajectories near (1,0) can be seen from Eq. (13). If c 2 = 0, then there is one pair of 
trajectories that approaches the critical point along the x-axis. In other words, if the y pop¬ 
ulation is initially zero, then it remains zero forever. All other trajectories depart from the 
neighborhood of (1,0); if y is initially small and positive, then the y population grows with 
time. As t -> — oo, one trajectory approaches the saddle point tangent to the eigenvector £ (2) 
whose slope is —1.25. 


x = 0,y = 0 . 75 . This critical point is a state where species y is present but x is not. The 
analysis is similar to that for the point (1,0). The corresponding linear system is 


/ u\ _ / 0.25 0 \ /u\ 

\vJ ~ y—0.375 -0.75j \ 


d_ 

dt 


(14) 
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The eigenvalues and eigenvectors are 

ri = 0.25, ? (1) = ^ ; r 2 = -0.75, ? (2) = Q, (15) 

so the general solution of Eq. (14) is 



Thus the point (0,0.75) is also a saddle point. All trajectories leave the neighborhood of this 
point except one pair that approaches along the y-axis. The trajectory that approaches the 
saddle point as t — oo is tangent to the line with slope —0.375 determined by the eigenvector 
£ (1) . If the x population is initially zero, it will remain zero, but a small positive x population 
will grow. 

x = 0 . 5 , y = 0 . 5 . This critical point corresponds to a mixed equilibrium state, or coexis¬ 
tence, in the competition between the two species. The eigenvalues and eigenvectors of the 
corresponding linear system 


d (u\_ /—0.5 -0.5\ (u\ 
dt{v)- y—0.25 -0.5 J \v J 


are 


n = (-2 +V2)/4 = -0.146, 



r 2 = (-2 - >/2)/4 = -0.854, 



Therefore, the general solution of Eq. (17) is 



(17) 


(18) 


(19) 


Since both eigenvalues are negative, the critical point (0.5, 0.5) is an asymptotically sta¬ 
ble node of the linear system (17) and of the nonlinear system (3). All nearby trajectories 
approach the critical point as t oo. One pair of trajectories approaches the critical point 
along the line with slope V2/2 determined from the eigenvector £ (2) . All other trajecto¬ 
ries approach the critical point tangent to the line with slope — V2/2 determined from the 
eigenvector £ (1) . 

A phase portrait for the system (3) is shown in Figure 9.4.2. By looking closely at the 
trajectories near each critical point, you can see that they behave in the manner predicted by 
the linear system near that point. In addition, note that the quadratic terms on the right side 
of Eqs. (3) are all negative. Since for x and y large and positive these terms are the dominant 
ones, it follows that far from the origin in the first quadrant both x! and y' are negative; that 
is, the trajectories are directed inward. Thus all trajectories that start at a point (x 0 ,y 0 ) with 
xo > 0 and yo > 0 eventually approach the point (0.5,0.5). In other words, the entire open first 
quadrant is the basin of attraction for (0.5,0.5). 
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Discuss the qualitative behavior of the solutions of the system 

dx/dt — x(l — x — y), 
dy/dt = y(0.5 - 0.25y - 0.75x), 


( 20 ) 


when x and y are nonnegative. Observe that this system is also a special case of the system (2) 
for two competing species. 

Once again, there are four critical points, namely, (0,0), (1,0), (0,2), and (0.5,0.5), corre¬ 
sponding to equilibrium solutions of the system (20). Figure 9.4.3 shows a direction field for 
the system (20), together with the four critical points. From the direction field it appears that the 
mixed equilibrium solution (0.5,0.5) is a saddle point, and therefore unstable, while the points 
(1,0) and (0,2) are asymptotically stable. Thus, for competition described by Eqs. (20), one 
species will eventually overwhelm the other and drive it to extinction. The surviving species is 
determined by the initial state of the system. To confirm these conclusions, we can look at the 
linear approximations near each critical point. For later use, we record the Jacobian matrix J 
for the system (20): 


/ F x (x,y ) F y (x,y)\ _ /l-2x-y -x 

yG x (x,y) G y (x,y) J y —0.75y 0.5 — 0.5y — 0.75x 


( 21 ) 


x = 0, y = 0. Using the Jacobian matrix J from Eq. (21) evaluated at (0,0), we obtain the 
linear system 


d 

dt 




( 22 ) 


which is valid near the origin. The eigenvalues and eigenvectors of the system (22) are 


(i) 



r 2 = 0.5, 


£ 2 ) = 


n = l, ? ( 


(23) 
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FIGURE 9.4.3 Critical points and direction field for the system (20). 

so the general solution is 



Therefore, the origin is an unstable node of the linear system (22) and also of the nonlinear 
system (20). All trajectories leave the neighborhood of the origin tangent to the y-axis except 
for one trajectory that lies along the x-axis. 


x = 1, y = 0. The corresponding linear system is 


d ( u \ _ (~ l -1 \ r 

Jt ~~ \ 0 -0.25/ [v 


(25) 


Its eigenvalues and eigenvectors are 


ri = -1, f 


(i) 


r 2 = -0.25, f 


( 2 ) 


(26) 


and its general solution is 


„,=M 0 K + C U l e 


( 27 ) 
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The point (1,0) is an asymptotically stable node of the linear system (25) and of the nonlinear 
system (20). If the initial values of x and y are sufficiently close to (1,0), then the interaction 
process will lead ultimately to that state—that is, to the survival of species x and the extinction 
of species y. There is one pair of trajectories that approaches the critical point along the x-axis. 
All other trajectories approach (1,0) tangent to the line with slope —3/4 that is determined 
by the eigenvector £ (2) . 


x = 0, y = 2. The analysis in this case is similar to that for the point (1,0). The appropriate 
linear system is 


d (u 
dt \ v 


-1 


0 


^—1.5 —0.5 1 \ v 

The eigenvalues and eigenvectors of this system are 

n = -l. I (1) = 


l) 

3/’ 


r 2 = -0.5, $ (2) = 


and its general solution is 


: c i 


e t + c 2 


„- 0 . 5 1 


(28) 


(29) 


(30) 


Thus the critical point (0,2) is an asymptotically stable node of both the linear system (28) and 
the nonlinear system (20). All nearby trajectories approach the critical point tangent to the 
y-axis except for one trajectory that approaches along the line with slope 3. 


x = 0.5, y = 0.5. The corresponding linear system is 


d tu 
dt \v 

The eigenvalues and eigenvectors are 
-5 +V57 


-0.5 

-0.375 


n = 


r 2 = 


16 

-5-V51 

16 


so the general solution is 


: c i 


= 0.1594, £ (1) = 

= -0.7844, £ (2) = 


-0.5 
-0.125/ \v 


(-3 - V57)/8 


1 

-1.3187 
1 


1 \ L) 

(-3 + V57)/8/ \ 0.5687 


-1.3187 


e 0.1594, +C2 


1 

0.5687 


(31) 


(32) 


(33) 


Since the eigenvalues are of opposite signs, the critical point (0.5,0.5) is a saddle point and 
therefore is unstable, as we had surmised earlier. All trajectories depart from the neighbor¬ 
hood of the critical point except for one pair that approaches the saddle point as t oo. 
As they approach the critical point, the entering trajectories are tangent to the line with slope 
(V57 — 3)/8 = 0.5687 determined from the eigenvector £ (2) . There is also a pair of trajectories 
that approach the saddle point as t — oo. These trajectories are tangent to the line with slope 
-1.3187 corresponding to £ (1) . 

A phase portrait for the system (20) is shown in Figure 9.4.4. Near each of the critical 
points, the trajectories of the nonlinear system behave as predicted by the corresponding 
linear approximation. Of particular interest is the pair of trajectories that enter the saddle 
point. These trajectories form a separatrix that divides the first quadrant into two basins of 
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attraction. Trajectories starting above the separatrix ultimately approach the node at (0,2), 
while trajectories starting below the separatrix approach the node at (1,0). If the initial state 
lies precisely on the separatrix, then the solution (x, y) will approach the saddle point as t -> oo. 
However, the slightest perturbation of the point (x,y) as it follows this trajectory will dislodge 
the point from the separatrix and cause it to approach one of the nodes instead. Thus, in 
practice, one species will survive the competition and the other will not. 



FIGURE 9.4.4 A phase portrait of the system (20). The black curve is the separatrix. 


Examples 1 and 2 show that in some cases the competition between two species 
leads to an equilibrium state of coexistence, while in other cases the competition 
results in the eventual extinction of one of the species. To understand more clearly 
how and why this happens, and to learn how to predict which situation will occur, it is 
useful to look again at the general system (2). There are four cases to be considered, 
depending on the relative orientation of the lines 

6i — o\x — a\y — 0 and 62 — o^y — ol^x = 0, (34) 

as shown in Figure 9.4.5. These lines are called the x- and y-nullclines, respectively, 
because x' is zero on the first and y' is zero on the second. In each part of Figure 9.4.5, 
the x-nullcline is the solid line and the y-nullcline is the dashed line. 

Let ( X , Y) denote any critical point in any one of the four cases. As in Examples 
1 and 2, the system (2) is locally linear in the neighborhood of this point because the 
right side of each differential equation is a quadratic polynomial. To study the system 
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FIGURE 9.4.5 The various cases for the competing-species system (2). The x-nullcline is 
the solid line, and the y-nullcline is the dashed line. 


( 2 ) in the neighborhood of this critical point, we can look at the corresponding linear 
system obtained from Eq. (13) of Section 9.3: 

d_ ( u \ _ ( €l ~ 2aiX ~ aiY ~ aiX \ AA / 35 x 

dt \v) \ — oi^Y €2— 2 g 2Y — a2Xj \v) 

We now use Eq. (35) to determine the conditions under which the model described 
by Eqs. (2) permits the coexistence of the two species x and y. Of the four possible 
cases shown in Figure 9.4.5, coexistence is possible only in cases (c) and ( d ). In these 
cases, the nonzero values of X and Y are obtained by solving the algebraic equations 
(34); the result is 


X = Clff2 ~ g2Q!l , Y = g2gl ~ eiQ!2 . (36) 

0\02 — 0l\0l2 <71*72 — 0L\0i2 

Further, since €\ — a\X — a\Y = 0 and 62 — 02 Y — 012 X = 0, Eq. (35) immediately 
reduces to 

d fu\ f—u\X — a\X\ fu\ 

Jt\v) = \-a 2 Y —cr 2 Y) ' 

The eigenvalues of the system (37) are found from the equation 

A T (cf\X T <J 2 Y)r T (oqo^ — ot\ot 2 )XY = 0. 


(37) 

(38) 
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PROBLEMS 


Thus 

~(a\X + a 2 Y) ± 7 (o\X + o 2 Y) 2 - 4(o x o 2 - a x a 2 )XY 

''1,2 =-j-' ( 39 ) 

If aia 2 — aqc^ < 0, then the radicand of Eq. (39) is positive and greater than 
(a\ X + <t 2 Y) 2 . Thus the eigenvalues are real and opposite in sign. Consequently, 
the critical point ( X , Y) is an (unstable) saddle point, and coexistence is not pos¬ 
sible. This is the case in Example 2, where o\ — 1, cq — 1, 07 = 0.25, a 2 = 0.75, and 
0\02 — Oi\Oi2 — —0.5. 

On the other hand, if o \02 — a\OL 2 > 0, then the radicand of Eq. (39) is less than 
(p\X + 02 Y) 2 . Thus the eigenvalues are real, negative, and unequal, or complex with 
negative real part. A straightforward analysis of the radicand of Eq. (39) shows that 
the eigenvalues cannot be complex (see Problem 7). Thus the critical point is an 
asymptotically stable node, and sustained coexistence is possible. This is illustrated 
by Example 1, where o\ — 1, oq = 1 ,02 = 1 ,07 = 0.5, and 0102 — 0102 = 0.5. 

Let us relate this result to Figures 9.4.5c and 9.4.5 d. In Figure 9.4.5c we have 

€l 62 j 62 61 

— > — or 6102 > £201 and — > — or 620:1 > 6107 - (40) 

01 0 L 2 02 a 1 

These inequalities, coupled with the condition that X and Y given by Eqs. (36) be 
positive, yield the inequality oio 2 < 0102 - Hence in this case the critical point is a 
saddle point. On the other hand, in Figure 9.4.5c/ we have 

*T €2 ^ 62 €l //ii \ 

— < — or €\d 2 < 62^1 and — < — or 620:1 < € 102 . (41) 

G\ Ot2 Cf2 oq 

Now the condition that X and Y be positive yields a\cf 2 > ot\oi 2 - Hence the critical 
point is asymptotically stable. For this case we can also show that the other 
critical points (0,0), (ci/oq, 0), and (0, 62 / 07 ) are unstable. Thus for any positive initial 
values of x and y, the two populations approach the equilibrium state of coexistence 
given by Eqs. (36). 

Equations (2) provide the biological interpretation of the result that whether coex¬ 
istence occurs depends on whether o\<j 2 — a\a 2 is positive or negative. The a’s are 
a measure of the inhibitory effect that the growth of each population has on itself, 
whereas the a’s are a measure of the inhibiting effect that the growth of each popu¬ 
lation has on the other species. Thus, when <ti<T 2 > 0 : 10 : 2 , interaction (competition) is 
“weak” and the species can coexist; when o \02 < 0 : 10 : 2 , interaction (competition) 
is “strong” and the species cannot coexist—one must die out. 


Each of Problems 1 through 6 can be interpreted as describing the interaction of two species 
with populations x and y. In each of these problems, carry out the following steps. 

(a) Draw a direction field and describe how solutions seem to behave. 

(b) Find the critical points. 

(c) For each critical point find the corresponding linear system. Find the eigenvalues and 
eigenvectors of the linear system; classify each critical point as to type, and determine whether 
it is asymptotically stable, stable, or unstable. 

(d) Sketch the trajectories in the neighborhood of each critical point. 
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(e) Compute and plot enough trajectories of the given system to show clearly the behavior of 
the solutions. 

(f) Determine the limiting behavior of x and y as t oo, and interpret the results in terms 
of the populations of the two species. 



1 . 

dx/dt 

= x(1.5 - x - 0.5y) 

41 

2 . 

dx/dt 

= x(1.5 

— x - 

0.5y) 



dy/dt 

= y(2 — y — 0.75x) 



dy/dt 

= y(2 - 

0.5y 

- 1.5 a) 

41 

3. 

dx/dt 

= x(1.5 — 0.5x — y) 

41 

4. 

dx/dt 

= x(1.5 

— 0.5x — y) 



dy/dt 

= y(2 — y — 1.125x) 



dy/dt 

= y(0.75 — y 

- 0.125*) 

41 

5. 

dx/dt 

= x(l — x — y) 

41 

6 . 

dx/dt 

= x(l — 

x + 0 

'.5 y) 



dy/dt 

= y(X-5-y-x) 



dy/dt 

= y( 2.5 

— 1.5y + 0.25x) 


7. 

Consider the eigenvalues given 

by Eq. (39) in 

the text. Show 

that 



(giX + g 2 Y) 2 — 4{g\g 2 — a\a 2 )XY = ( o\X — g 2 Y) 2 + 4a\a 2 XY . 


Hence conclude that the eigenvalues can never be complex. 

8 . Two species of fish that compete with each other for food, but do not prey on each other, 
are bluegill and redear. Suppose that a pond is stocked with bluegill and redear, and let 
x and y be the populations of bluegill and redear, respectively, at time t. Suppose further 
that the competition is modeled by the equations 


dx/dt = x(e\ — G\X — cqy), 
dy/dt = y(e 2 - G 2 y - ct 2 x). 


(a) If e 2 /a 2 > €\/g\ and € 2 /g 2 > t\/oi\, show that the only equilibrium populations in the 
pond are no fish, no redear, or no bluegill. What will happen for large ft 

(b) If €\/oi > € 2 /a 2 and €\/ot\ > € 2 /g 2 , show that the only equilibrium populations in the 
pond are no fish, no redear, or no bluegill. What will happen for large ft 

9. Consider the competition between bluegill and redear mentioned in Problem 8 . Suppose 
that € 2 /a 2 > €\/g\ and €\/ct\ > € 2 /g 2 , so, as shown in the text, there is a stable equilibrium 
point at which both species can coexist. It is convenient to rewrite the equations of Problem 
8 in terms of the carrying capacity of the pond for bluegill (B = £\/g\) in the absence of 
redear and its carrying capacity for redear (R = € 2 /g 2 ) in the absence of bluegill. 

(a) Show that the equations of Problem 8 take the form 


dx 

dt 




dy 

dt 


=e2y ( 1 -\ y - Y i x )' 


where y\ = ol\/g\ and y 2 = ol 2 /g 2 . Determine the coexistence equilibrium point (. X , Y) in 
terms of B , R , y l9 and y 2 . 

(b) Now suppose that an angler fishes only for bluegill with the effect that B is reduced. 
What effect does this have on the equilibrium populations? Is it possible, by fishing, to 
reduce the population of bluegill to such a level that they will die out? 

10. Consider the system (2) in the text, and assume that g x g 2 — ol\ol 2 — 0. 

(a) Find all the critical points of the system. Observe that the result depends on whether 
gi€ 2 — a 2 ei is zero. 

(b) If Gie 2 — a 2 ei > 0, classify each critical point and determine whether it is asymptoti¬ 
cally stable, stable, or unstable. Note that Problem 5 is of this type. Then do the same if 
g\€ 2 — a 2 e\ < 0 . 

(c) Analyze the nature of the trajectories when G\e 2 — a 2 e\ = 0. 
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11. Consider the system (3) in Example 1 of the text. Recall that this system has an asymptot¬ 
ically stable critical point at (0.5,0.5), corresponding to the stable coexistence of the two 
population species. Now suppose that immigration or emigration occurs at the constant 
rates of 8a and 8b for the species x and y, respectively. In this case Eqs. (3) are replaced by 

dx/dt = x(l — x — y) + 8a, 

(i) 

dy/dt = y(0.75 — y — 0.5x) + 8b. 

The question is what effect this has on the location of the stable equilibrium point. 

(a) To find the new critical point, we must solve the equations 

x(l — x — y) + 8a = 0, 

(h) 

y(0.75 —y — 0.5x) + 8b = 0. 

One way to proceed is to assume that x and y are given by power series in the parameter 
<5; thus 

x = Xo+Xi 8-\ -, y = y 0 + y\8 4-. (iii) 

Substitute Eqs. (iii) into Eqs. (ii) and collect terms according to powers of 8. 

(b) From the constant terms (the terms not involving 8), show that x 0 = 0.5 and y 0 = 0.5, 
thus confirming that in the absence of immigration or emigration, the critical point is 
(0.5,0.5). 

(c) From the terms that are linear in 8 , show that 

x\ = 4a — 4 b, yi = —2a + 4 b. (iv) 

(d) Suppose that a > 0 and b > 0 so that immigration occurs for both species. Show that 
the resulting equilibrium solution may represent an increase in both populations, or an 
increase in one but a decrease in the other. Explain intuitively why this is a reasonable 
result. 

12. The system 

x! = —y, y' = —yy — x(x — 0.15)(x — 2) 

results from an approximation to the Hodgkin-Huxley 5 equations, which model the 
transmission of neural impulses along an axon. 

(a) Find the critical points, and classify them by investigating the approximate linear 
system near each one. 

(b) Draw phase portraits for y = 0.8 and for y = 1.5. 

(c) Consider the trajectory that leaves the critical point (2,0). Find the value of y for 
which this trajectory ultimately approaches the origin as t oo. Draw a phase portrait 
for this value of y. 

Bifurcation Points. Consider the system 

x' = F(x,y,a), y' = G(x,y, a), (i) 

where a is a parameter. The equations 

F(x,y,a) = 0, G(x,y,a) = 0 (ii) 


5 Sir Alan L. Hodgkin (1914-1998) and Sir Andrew E Huxley (1917- ), British physiologists and bio¬ 
physicists, studied the excitation and transmission of neural impulses at Cambridge University and the 
Marine Biological Association Laboratory in Plymouth. This work was both theoretical (resulting in a 
system of nonlinear differential equations) and experimental (involving measurements on the giant axon 
of the Atlantic squid). They were awarded the Nobel Prize in Physiology or Medicine in 1963. 
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determine the x- and y-nullclines, respectively; any point where an x-nullcline and a 
y-nullcline intersect is a critical point. As a varies and the configuration of the nullclines 
changes, it may well happen that, at a certain value of a, two critical points coalesce into one. 
For further variation in a, the critical point may once again separate into two critical points, 
or it may disappear altogether. Or the process may occur in reverse: For a certain value of a , 
two formerly nonintersecting nullclines may come together, creating a critical point, which, 
for further changes in a, may split into two. A value of a at which such phenomena occur is 
a bifurcation point. It is also common for a critical point to experience a change in its type 
and stability properties at a bifurcation point. Thus both the number and the kind of critical 
points may change abruptly as a passes through a bifurcation point. Since a phase portrait of a 
system is very dependent on the location and nature of the critical points, an understanding of 
bifurcations is essential to an understanding of the global behavior of the system’s solutions. 

In each of Problems 13 through 16: 

(a) Sketch the nullclines and describe how the critical points move as a increases. 

(b) Find the critical points. 

(c) Let a = 2. Classify each critical point by investigating the corresponding approximate 
linear system. Draw a phase portrait in a rectangle containing the critical points. 

(d) Find the bifurcation point a 0 at which the critical points coincide. Locate this critical point, 
and find the eigenvalues of the approximate linear system. Draw a phase portrait. 

(e) For a > a 0 there are no critical points. Choose such a value of a and draw a phase portrait. 

13. x' = —4x + y + x 2 , y = \a — y 

jfZ 14. x' = \a - y, y = —Ax + y + x 2 

15. x' = —Ax + y + x 2 , y — — a — x + y 

16. x' = —a — x + y, y' = —Ax + y + x 2 


Problems 17 through 19 deal with competitive systems much like those in Examples 1 and 2, 
except that some coefficients depend on a parameter a. In each of these problems, assume that 
x,y, and a are always nonnegative. In each of Problems 17 through 19: 

(a) Sketch the nullclines in the first quadrant, as in Figure 9.4.5. For different ranges of a your 
sketch may resemble different parts of Figure 9.4.5. 

(b) Find the critical points. 

(c) Determine the bifurcation points. 

(d) Find the Jacobian matrix J, and evaluate it for each of the critical points. 

(e) Determine the type and stability property of each critical point. Pay particular attention 
to what happens as a passes through a bifurcation point. 

(f) Draw phase portraits for the system for selected values of a to confirm your conclusions. 

17. dx/dt = x(l — x — y), dy/dt = y(a — y — 0.5x) 

18. dx/dt = x(l —x — y), dy/dt = y(0.75 — ay - 0.5x) 

19. dx/dt = x(l — x — y), dy/dt = y[a — y — (2a — l)x] 


9.5 Predator-Prey Equations 


In the preceding section we discussed a model of two species that interact by 
competing for a common food supply or other natural resource. In this section we 
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investigate the situation in which one species (the predator) preys on the other species 
(the prey), while the prey lives on a different source of food. For example, consider 
foxes and rabbits in a closed forest. The foxes prey on the rabbits, the rabbits live 
on the vegetation in the forest. Other examples are bass in a lake as predators and 
redear as prey, and ladybugs as predators and aphids as prey. We emphasize again 
that a model involving only two species cannot fully describe the complex relation¬ 
ships among species that actually occur in nature. Nevertheless, the study of simple 
models is the first step toward an understanding of more complicated phenomena. 

We will denote by x and y the populations of the prey and predator, respectively, 
at time t. In constructing a model of the interaction of the two species, we make the 
following assumptions: 

1. In the absence of the predator, the prey grows at a rate proportional to the current 
population; thus dx/dt = ax, a > 0, when y = 0. 

2. In the absence of the prey, the predator dies out; thus dy/dt = —cy, c > 0, when x = 0. 

3. The number of encounters between predator and prey is proportional to the product 
of their populations. Each such encounter tends to promote the growth of the predator 
and to inhibit the growth of the prey. Thus the growth rate of the predator is increased by 
a term of the form yxy, while the growth rate of the prey is decreased by a term —axy, 
where y and a are positive constants. 

As a consequence of these assumptions, we are led to the equations 
dx/dt = ax — axy = x(a — ay), 
dy/dt = — cy + yxy = y(—c + yx). 

The constants a, c , a, and y are all positive; a and c are the growth rate of the prey 
and the death rate of the predator, respectively, and a and y are measures of the effect 
of the interaction between the two species. Equations (1) are known as the Lotka- 
Volterra equations. They were developed in papers by Lotka 6 in 1925 and by Volterra 7 
in 1926. Although these are rather simple equations, they do characterize a wide class 
of problems. Ways of making them more realistic are discussed at the end of this 
section and in the problems. Our goal here is to determine the qualitative behavior 
of the solutions (trajectories) of the system (1) for arbitrary positive initial values of x 
and y. We first do this for a specific example and then return to the general equations 
(1) at the end of the section. 


6 Alfred J. Lotka (1880-1949), an American biophysicist, was born in what is now Ukraine and was educated 
mainly in Europe. He is remembered chiefly for his formulation of the Lotka-Volterra equations. He was 
also the author, in 1924, of the first book on mathematical biology; it is now available as Elements of 
Mathematical Biology (New York: Dover, 1956). 

7 Vito Volterra (1860-1940), a distinguished Italian mathematician, held professorships at Pisa, Turin, 
and Rome. He is particularly famous for his work in integral equations and functional analysis. Indeed, 
one of the major classes of integral equations is named for him; see Problem 21 of Section 6.6. His theory 
of interacting species was motivated by data collected by a friend, D’Ancona, concerning fish catches 
in the Adriatic Sea. A translation of his 1926 paper can be found in an appendix to R. N. Chapman, 
Animal Ecology with Special Reference to Insects (New York: McGraw-Hill, 1931). 
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EXAMPLE 

1 


Discuss the solutions of the system 

dx/dt — x(l — 0.5y) = x — 0.5xy = F(x,y), 

( 2 ) 

dy/dt = y(— 0.75 + 0.25x) = —0.75y + 0.25 xy = G(x,y) 
for x and y positive. 

The critical points of this system are the solutions of the algebraic equations 

x(l - 0.5y) = 0, y(—0.75 + 0.25x) = 0, (3) 

namely, the points (0,0) and (3,2). Figure 9.5.1 shows the critical points and a direction field 
for the system (2). From this figure it appears that trajectories in the first quadrant encircle the 
critical point (3,2). Whether the trajectories are actually closed curves, or whether they slowly 
spiral in or out, cannot be definitely determined from the direction field. The origin appears to 
be a saddle point. Just as for the competition equations in Section 9.4, the coordinate axes are 
trajectories of Eqs. (1) or (2). Consequently, no other trajectory can cross a coordinate axis, 
which means that every solution starting in the first quadrant remains there for all time. 
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FIGURE 9.5.1 Critical points and direction field for the predator-prey system (2). 


Next we examine the local behavior of solutions near each critical point. Near the origin 
we can neglect the nonlinear terms in Eqs. (2) to obtain the corresponding linear system 



The eigenvalues and eigenvectors of Eq. (4) are 

'•1=1, = Q ; r 2 = —0.75, ^, (5) 

so its general solution is 



(6) 
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Thus the origin is a saddle point both of the linear system (4) and of the nonlinear system (2) 
and therefore is unstable. One pair of trajectories enters the origin along the y-axis; all other 
trajectories depart from the neighborhood of the origin. 

To examine the critical point (3,2), we can use the Jacobian matrix 


J _/F x (x,y) /v(x,y)\ _ /l — 0.5y -0.5* \ 

yG x (*,y) G y (x,y)J y 0.25y —0.75 + 0.25*y 

Evaluating J at the point (3,2), we obtain the linear system 

d_ (u\ _ A) -1.5\ (u\ 

Jt \vJ ~ y0.5 0 )\y) 9 


(7) 

( 8 ) 


where u = x — 3 and v = y — 2. The eigenvalues and eigenvectors of this system are 



Since the eigenvalues are imaginary, the critical point (3,2) is a center of the linear system 
(8) and is therefore a stable critical point for that system. Recall from Section 9.3 that this 
is one of the cases in which the behavior of the linear system may or may not carry over to 
the nonlinear system, so the nature of the point (3,2) for the nonlinear system (2) cannot be 
determined from this information. 

The simplest way to find the trajectories of the linear system (8) is to divide the second of 
Eqs. (8) by the first so as to obtain the differential equation 

dv dv/dt 0.5w u 
du du/dt — 1.5v 3v ’ 

or 

u du + 3i> dv = 0. (10) 

Consequently, 

u 2 + 3 i > 2 = k, ( 11 ) 

where k is an arbitrary nonnegative constant of integration. Thus the trajectories of the linear 
system (8) are ellipses centered at the critical point and elongated somewhat in the horizontal 
direction. 

Now let us return to the nonlinear system (2). Dividing the second of Eqs. (2) by the first, 
we obtain 

dy _ y(- 0.75 + 0.25x) 
dx x(l — 0.5y) 

Equation (12) is a separable equation and can be put in the form 

1 — 0.5y -0.75 + 0.25* 

- dy = - dx , 

y x 

from which it follows that 


0.75 In* + lny — 0.5y — 0.25* = c, (13) 

where c is a constant of integration. Although by using only elementary functions we cannot 
solve Eq. (13) explicitly for either variable in terms of the other, it is possible to show that the 
graph of the equation for a fixed value of c is a closed curve surrounding the critical point 
(3,2). Thus the critical point is also a center of the nonlinear system (2), and the predator and 
prey populations exhibit a cyclic variation. 
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Figure 9.5.2 shows a phase portrait of the system (2). For some initial conditions, the tra¬ 
jectory represents small variations in x and y about the critical point and is almost elliptical 
in shape, as the linear analysis suggests. For other initial conditions, the oscillations in x and y 
are more pronounced, and the shape of the trajectory is significantly different from an ellipse. 
Observe that the trajectories are traversed in the counterclockwise direction. The dependence 
of v and y on t for a typical set of initial conditions is shown in Figure 9.5.3. Note that x and 
y are periodic functions of t, as they must be since the trajectories are closed curves. Fur¬ 
ther, the oscillation of the predator population lags behind that of the prey. Starting from a 
state in which both predator and prey populations are relatively small, the prey first increase 
because there is little predation. Then the predators, with abundant food, increase in pop¬ 
ulation also. This causes heavier predation, and the prey tend to decrease. Finally, with a 
diminished food supply, the predator population also decreases, and the system returns to the 
original state. 




FIGURE 9.5.3 Variations of the prey and predator populations with time for the system (2). 
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The general system (1) can be analyzed in exactly the same way as in the example. 
The critical points of the system (1) are the solutions of 

x(a — ay) = 0, y(—c + yx) = 0, 


that is, the points (0,0) and (c/y,a/a). We first examine the solutions of the 
corresponding linear system near each critical point. 

In the neighborhood of the origin, the corresponding linear system is 


XX -X) 

The eigenvalues and eigenvectors are 


ri = a , 




so the general solution is 



= ci 



e at + c 2 



e 


—ct 


(14) 


(15) 


(16) 


Thus the origin is a saddle point and hence unstable. Entrance to the saddle point is 
along the y-axis; all other trajectories depart from the neighborhood of the critical 
point. 

Next consider the critical point (c/y, a/a). The Jacobian matrix is 


( a — ay —ax 

yy -c + yx 


Evaluating J at (c/y, a/a), we obtain the approximate linear system 


d (u\ _ / 0 -ac/y\ / u \ 
dt \ry \ya/a 0 ) \ v ) 


(17) 


where u = x — (c/y) and v = y — (a/a). The eigenvalues of the system (17) are 
r = ±i^/dc, so the critical point is a (stable) center of the linear system. To find 


the trajectories of the system (17), we can divide the second equation by the first to 

obtain 

dv dv/dt (ya/a)u 

(18) 


du du/dt (ac/y)v’ 

or 

y 2 au du + a 2 cv dv = 0. 

(19) 

Consequently, 

y 2 au 2 + a 2 cv 2 = k , 

(20) 


where k is a nonnegative constant of integration. Thus the trajectories of the linear 
system (17) are ellipses, just as in the example. 

Returning briefly to the nonlinear system (1), observe that it can be reduced to the 
single equation 

dy dy/dt y(—c + yx) 
dx dx/dt x(a — ay) 


(21) 
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Equation (21) is separable and has the solution 

a\ny — ay + c\nx — yx = C, (22) 


where C is a constant of integration. Again, it is possible to show that for fixed C, the 
graph of Eq. (22) is a closed curve surrounding the critical point (c/y, a/a). Thus this 
critical point is also a center for the general nonlinear system (1). 

The cyclic variation of the predator and prey populations can be analyzed in more 
detail when the deviations from the point (c/y, a/a) are small and the linear system 
(17) can be used. The solution of the system (17) can be written in the form 


u = -K cos (^fac t + 0), 
Y 


v = — -K sin (<sfac t + 0), 
a\ a 


where the constants K and 0 are determined by the initial conditions. Thus 

Q Q 

x — —}—K cos (yfac t + 0), 

Y Y 

y = — + - J^-K sin (y/act + 0). 
a a V a 


(23) 


(24) 


These equations are good approximations for the nearly elliptical trajectories close 
to the critical point (c/y,a/a). We can use them to draw several conclusions about 
the cyclic variation of the predator and prey on such trajectories. 

1. The sizes of the predator and prey populations vary sinusoidally with period 2n/ y/ac. This 
period of oscillation is independent of the initial conditions. 

2. The predator and prey populations are out of phase by one-quarter of a cycle. The prey 
leads and the predator lags, as explained in the example. 

3. The amplitudes of the oscillations are Kc/y for the prey and a^/cK/a^/a for the predator 
and hence depend on the initial conditions as well as on the parameters of the problem. 

4. The average populations of predator and prey over one complete cycle are c/y and a/a, 
respectively. These are the same as the equilibrium populations; see Problem 10. 


Cyclic variations of predator and prey as predicted by Eqs. (1) have been observed 
in nature. One striking example is described by Odum (pp. 191-192); based on the 
records of the Hudson’s Bay Company of Canada, the abundance of lynx and snow- 
shoe hare, as indicated by the number of pelts turned in over the period 1845-1935, 
shows a distinct periodic variation with period of 9 to 10 years. The peaks of abun¬ 
dance are followed by very rapid declines, and the peaks of abundance of the lynx 
and hare are out of phase, with that of the hare preceding that of the lynx by a year 
or more. 

Since the critical point (c/y, a/a) is a center, we expect that small perturbations 
of the Lotka-Volterra equations may well lead to solutions that are not periodic. 
To put it another way, unless the Lotka-Volterra equations exactly describe a given 
predator-prey relationship, the actual fluctuations of the populations may differ 
substantially from those predicted by the Lotka-Volterra equations, due to small 
inaccuracies in the model equations. This has led to many attempts 8 to replace the 


8 See the book by Brauer and Castillo-Chavez listed in the references for an extensive discussion of 
alternative models for predator-prey relationships. 
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Lotka-Volterra equations by other systems that are less susceptible to the effects of 
small perturbations. Problem 13 introduces one such alternative model. 

Another criticism of the Lotka-Volterra equations is that in the absence of 
the predator, the prey will grow without bound. This can be corrected by allow¬ 
ing for the natural inhibiting effect that an increasing population has on the growth 
rate of that population. For example, the first of Eqs. (1) can be modified so that 
when y = 0, it reduces to a logistic equation for x. The effects of this modification are 
explored in Problems 11 and 12. Problems 14 through 16 deal with harvesting in a 
predator-prey relationship. The results may seem rather counterintuitive. 

Finally, we repeat a warning stated earlier: relationships among species in the 
natural world are often complex and subtle. You should not expect too much of a 
simple system of two differential equations in describing such relationships. Even if 
you are convinced that the general form of the equations is sound, the determination 
of numerical values for the coefficients may present serious difficulties. 


PROBLEMS Each of Problems 1 through 5 can be interpreted as describing the interaction of two species 
with population densities x and y. In each of these problems, carry out the following steps. 

(a) Draw a direction field and describe how solutions seem to behave. 

(b) Find the critical points. 

(c) For each critical point, find the corresponding linear system. Find the eigenvalues and 
eigenvectors of the linear system; classify each critical point as to type, and determine whether 
it is asymptotically stable, stable, or unstable. 

(d) Sketch the trajectories in the neighborhood of each critical point. 

(e) Draw a phase portrait for the system. 

(f) Determine the limiting behavior of x and y as t oo, and interpret the results in terms 
of the populations of the two species. 


41 1. dx/dt = x(1.5 — 0.5y) 
dy/dt = y(—0.5 +x) 

41 3. dx/dt = x(l — 0.5x — 0.5y) 
dy/dt = y{— 0.25 + 0.5x) 

41 5. dx/dt = x(—1 + 2.5x — 0.3y — x 2 ) 
dy/dt = y(—1.5 + x) 


41 2. dx/dt = x(l — 0.5y) 

dy/dt = y(—0.25 + 0.5x) 

41 4. dx/dt = x(1.125 - x - 0.5y) 
dy/dt = y (—1 + x) 


6. In this problem we examine the phase difference between the cyclic variations of the 
predator and prey populations as given by Eqs. (24) of this section. Suppose we assume 
that K > 0 and that t is measured from the time that the prey population x is a maximum; 
then 0 = 0. 

(a) Show that the predator population y is a maximum at t = n/l^fac — T /4, where T is 
the period of the oscillation. 

(b) When is the prey population increasing most rapidly? decreasing most rapidly? a 
minimum? 

(c) Answer the questions in part (b) for the predator population. 

(d) Draw a typical elliptic trajectory enclosing the point ( c/y,a/a ), and mark on it the 
points found in parts (a), (b), and (c). 

7. (a) Find the ratio of the amplitudes of the oscillations of the prey and predator populations 
about the critical point ( c/y,a/ot ), using the approximation (24), which is valid for small 
oscillations. Observe that the ratio is independent of the initial conditions. 
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(b) Evaluate the ratio found in part (a) for the system (2). 

(c) Estimate the amplitude ratio for the solution of the nonlinear system (2) shown in 
Figure 9.5.3. Does the result agree with that obtained from the linear approximation? 

(d) Determine the prey-predator amplitude ratio for other solutions of the system (2) 
—that is, for solutions satisfying other initial conditions. Is the ratio independent of the 
initial conditions? 

8. (a) Find the period of the oscillations of the prey and predator populations, using the 
approximation (24), which is valid for small oscillations. Note that the period is inde¬ 
pendent of the amplitude of the oscillations. 

(b) For the solution of the nonlinear system (2) shown in Figure 9.5.3, estimate the period 
as well as possible. Is the result the same as for the linear approximation? 

(c) Calculate other solutions of the system (2)—that is, solutions satisfying other initial 
conditions—and determine their periods. Is the period the same for all initial conditions? 

9. Consider the system 

dx/dt = ax[ 1 — (y/2)], dy/dt = by[— 1 + (x/3)], 

where a and b are positive constants. Observe that this system is the same as in the example 
in the text if a = 1 and b = 0.75. Suppose the initial conditions are x(0) = 5 and y(0) = 2. 

(a) Fet a = 1 and b = 1. Plot the trajectory in the phase plane, and determine (or esti¬ 
mate) the period of the oscillation. 

(b) Repeat part (a) for a = 3 and a = 1/3, with b = 1. 

(c) Repeat part (a) for b = 3 and b = 1/3, with a = 1. 

(d) Describe how the period and the shape of the trajectory depend on a and b. 

10. The average sizes of the prey and predator populations are defined as 

^ pA+T ^ pA+T 

x = — J x(t ) dt, y=j] y ( { ) dt > 

respectively, where T is the period of a full cycle, and A is any nonnegative constant. 

(a) Using the approximation (24), which is valid near the critical point, show that x = c/y 
andy = a/a. 

(b) For the solution of the nonlinear system (2) shown in Figure 9.5.3, estimate x and y as 
well as you can. Try to determine whether x and y are given by c/y and a/a, respectively, 
in this case. 

Hint: Consider how you might estimate the value of an integral even though you do not 
have a formula for the integrand. 

(c) Calculate other solutions of the system (2)—that is, solutions satisfying other initial 
conditions—and determine x and y for these solutions. Are the values of x and y the same 
for all solutions? 

In Problems 11 and 12, we consider the effect of modifying the equation for the prey x by 
including a term —crx 2 so that this equation reduces to a logistic equation in the absence of 
the predator y. Problem 11 deals with a specific system of this kind, and Problem 12 takes 
up this modification to the general Fotka-Volterra system. The systems in Problems 3 and 
4 are other examples of this type. 

11. Consider the system 

x! — x(l — ax — 0.5y), / = y(— 0.75 + 0.25x), 

where a > 0. Observe that this system is a modification of the system (2) in Example 1. 



9.5 Predator-Prey Equations 


553 


(a) Find all of the critical points. How does their location change as o increases from zero? 
Observe that there is a critical point in the interior of the first quadrant only if o < 1/3. 

(b) Determine the type and stability property of each critical point. Find the value 
o\ < 1/3 where the nature of the critical point in the interior of the first quadrant changes. 
Describe the change that takes place in this critical point as o passes through o\. 

(c) Draw a direction field and phase portrait for a value of o between zero and o 1 ; for a 
value of o between o 1 and 1/3. 

(d) Describe the effect on the two populations as o increases from zero to 1/3. 

12. Consider the system 


dx/dt = x(a — ox — ay), dy/dt = y(—c + yx), 


where a, o, a, c, and y are positive constants. 

(a) Find all critical points of the given system. How does their location change as o 
increases from zero? Assume that a/o > c/y , that is, o < ay/c. Why is this assumption 
necessary? 

(b) Determine the nature and stability characteristics of each critical point. 

(c) Show that there is a value of o between zero and ay/c where the critical point in the 
interior of the first quadrant changes from a spiral point to a node. 

(d) Describe the effect on the two populations as o increases from zero to ay/c. 

13. In the Lotka-Volterra equations, the interaction between the two species is modeled by 
terms proportional to the product xy of the respective populations. If the prey population is 
much larger than the predator population, this may overstate the interaction; for example, 
a predator may hunt only when it is hungry and ignore the prey at other times. In this 
problem we consider an alternative model proposed by Rosenzweig and MacArthur. 9 

(a) Consider the system 



Find all of the critical points of this system. 

(b) Determine the type and stability characteristics of each critical point. 

(c) Draw a direction field and phase portrait for this system. 

Harvesting in a Predator-Prey Relationship. In a predator-prey situation, it may happen 
that one or perhaps both species are valuable sources of food. Or, the prey species may 
be regarded as a pest, leading to efforts to reduce its numbers. In a constant-effort model 
of harvesting, we introduce a term — E x x in the prey equation and a term — E 2 y in the 
predator equation, where E\ and E 2 are measures of the effort invested in harvesting 
the respective species. A constant-yield model of harvesting is obtained by including the 
term —Hi in the prey equation and the term —H 2 in the predator equation. The constants 
Ei, E 2 , Hi, and H 2 are always nonnegative. Problems 14 and 15 deal with constant-effort 
harvesting, and Problem 16 deals with constant-yield harvesting. 

14. Applying a constant-effort model of harvesting to the Lotka-Volterra equations (1), we 
obtain the system 


x' — x(a — ay — E\), y' — y(—c + yx — E 2 ). 
When there is no harvesting, the equilibrium solution is (c/y, a/a). 


9 See the book by Brauer and Castillo-Chavez for further details. 
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(a) Before doing any mathematical analysis, think about the situation intuitively. How do 
you think the populations will change if the prey alone is harvested? if the predator alone 
is harvested? if both are harvested? 

(b) How does the equilibrium solution change if the prey is harvested, but not the preda¬ 
tor (Ei > 0, E 2 = 0)? 

(c) How does the equilibrium solution change if the predator is harvested, but not the 
prey (E\ = 0, E 2 > 0)? 

(d) How does the equilibrium solution change if both are harvested (E x > 0, E 2 > 0)? 

15. If we modify the Lotka-Volterra equations by including a self-limiting term —ox 2 in the 
prey equation, and then assume constant-effort harvesting, we obtain the equations 

x! — x(a — ox — ay — Ei), y' = y(—c + yx — E 2 ). 

In the absence of harvesting, the equilibrium solution of interest is x = c/y, 
y = (a/a) - (oc)/(ay). 

(a) How does the equilibrium solution change if the prey is harvested, but not the preda¬ 
tor (Ei > 0, E 2 = 0)? 

(b) How does the equilibrium solution change if the predator is harvested, but not the 
prey (E\ = 0,E 2 > 0)? 

(c) How does the equilibrium solution change if both are harvested (Ei > 0, E 2 > 0)? 

16. In this problem we apply a constant-yield model of harvesting to the situation in Example 1. 
Consider the system 

x f — x(l — 0.5y) — Hi, y' = y(— 0.75 + 0.25x) — H 2 , 

where Hi and H 2 are nonnegative constants. Recall that if Hi = H 2 = 0, then (3,2) is an 
equilibrium solution for this system. 

(a) Before doing any mathematical analysis, think about the situation intuitively. How do 
you think the populations will change if the prey alone is harvested? if the predator alone 
is harvested? if both are harvested? 

(b) How does the equilibrium solution change if the prey is harvested, but not the preda¬ 
tor (Hi > 0,H 2 = 0)? 

(c) How does the equilibrium solution change if the predator is harvested, but not the 
prey (Hi = 0, H 2 > 0)? 

(d) How does the equilibrium solution change if both are harvested (Hi > 0, H 2 > 0)? 


9.6 Liapunov's Second Method 


In Section 9.3 we showed how the stability of a critical point of a locally linear 
system can usually be determined from a study of the corresponding linear system. 
However, no conclusion can be drawn when the critical point is a center of the 
corresponding linear system. Examples of this situation are the undamped pendulum, 
Eqs. (1) and (2) below, and the predator-prey problem discussed in Section 9.5. Also, 
for an asymptotically stable critical point, it may be important to investigate the 
basin of attraction—that is, the domain such that all solutions starting within that 
domain approach the critical point. The theory of locally linear systems provides no 
information about this question. 





9.6 Liapunov’s Second Method 


555 


In this section we discuss another approach, known as Liapunov’s 10 second method 
or direct method. The method is referred to as a direct method because no knowledge 
of the solution of the system of differential equations is required. Rather, conclusions 
about the stability or instability of a critical point are obtained by constructing a suit¬ 
able auxiliary function. The technique is a very powerful one that provides a more 
global type of information—for example, an estimate of the extent of the basin of 
attraction of a critical point. Liapunov’s second method can also be used to study 
systems of equations that are not locally linear; however, we will not discuss such 
problems. 


The Pendulum Equations. Basically, Liapunov’s second method is a generalization of 
two physical principles for conservative systems, namely, (i) a rest position is stable 
if the potential energy is a local minimum, otherwise it is unstable, and (ii) the total 
energy is a constant during any motion. To illustrate these concepts, again consider 
the undamped pendulum (a conservative mechanical system), which is governed 
by the equation 

o. a) 

The corresponding system of first order equations is 



dy 

dt 


— y sinx, 

L/ 


( 2 ) 


where x = 0 and y = dO/dt. If we omit an arbitrary constant, the potential energy U 
is the work done in lifting the pendulum above its lowest position, namely, 


U(x,y ) = mgL{l — cosx); 


( 3 ) 


see Figure 9.2.2. The critical points of the system (2) are x = ±rm, y = 0, for 
n = 0,1,2, 3,..., corresponding to 0 = ±nn , dO/dt = 0. Physically, we expect the 
pointsx = 0,y = 0;x = ±27r,y = 0;.. ^corresponding to 0 = 0, ±27t, ..., to be stable, 
since for them the pendulum bob is vertical with the weight down. Further, we expect 
the points x = ±tt, y = 0; x = ±37r, y = 0;..., corresponding to 6 = ±n, ±3n, ..., to 
be unstable, since for them the pendulum bob is vertical with the weight up. This 
agrees with statement (i), for at the former points U is a minimum equal to zero, and 
at the latter points U is a maximum equal to 2 mgL. 

Next consider the total energy V, which is the sum of the potential energy U and 
the kinetic energy \mL 2 (dO/dt) 2 . In terms of x and y, 

V(x,y) = mgL(l — cosx) + \mL 2 y 2 . (4) 


10 Alexander M. Liapunov (1857-1918), a student of Chebyshev at St. Petersburg, taught at the Uni¬ 
versity of Kharkov from 1885 to 1901, when he became an academician in applied mathematics at the 
St. Petersburg Academy of Sciences. In 1917 he moved to Odessa because of his wife’s frail health. His 
research in stability encompassed both theoretical analysis and applications to various physical problems. 
His second method formed part of his most influential work, General Problem of Stability of Motion , 
published in 1892. 




556 


Chapter 9 . Nonlinear Differential Equations and Stability 


On a trajectory corresponding to a solution x = 0(t), y = VKO of Eqs. (2), V can be 
considered a function of t. The derivative of E[0(t), \/r(t)] with respect to t is called 
the rate of change of V following the trajectory. By the chain rule, 


dV[<Kt),m] 

dt 




d(j){t) 

dt 


+ v y m\m'\ 


d\l/(t) 

dt 


dx ? dy 
(mgL srnx) — + mL y —, 
dt dt 


( 5 ) 


where it is understood that x = (p(t),y = t ). Finally, substituting in Eq. (5) for dx/dt 
and dy/dt from Eqs. (2), we find that dV/dt = 0. Hence V is a constant along any 
trajectory of the system (2), which is statement (ii). 

It is important to note that at any point (x,y), the rate of change of V along the 
trajectory through that point was computed without actually solving the system (2). 
It is precisely this fact that enables us to use Liapunov’s second method for systems 
whose solution we do not know, which is the main reason for its importance. 

At the stable critical points, x = ±2nn , y = 0, n = 0,1,2,..., the energy V is zero. 
If the initial state (%i,yi) of the pendulum is sufficiently near a stable critical point, 
then the energy V(xi,yi) is small, and the motion (trajectory) associated with this 
energy stays close to the critical point. It can be shown that if E(xi,yi) is sufficiently 
small, then the trajectory is closed and contains the critical point. For example, sup¬ 
pose that (xi,yi) is near (0,0) and that V(x\,y{) is very small. The equation of the 
trajectory with energy V(x\,y\) is 

V(x,y) = mgL( 1 — cosx) + \mL 2 y 2 = V(x\,y\). 

For x small, we have 1 — cosx = 1 — (1 — x 2 /2! H-) = x 2 /2. Thus the equation of 

the trajectory is approximately 

\mgLx 2 + \mL 2 y 2 = V(xi,yi), 


or 

x 2 y 2 

2V(x 1 ,y 1 )/mgL + 2V(xx,_y\)/mL 2 

This is an ellipse enclosing the critical point (0,0); the smaller V (xi, y\) is, the smaller 
are the major and minor axes of the ellipse. Physically, the closed trajectory corre¬ 
sponds to a solution that is periodic in time—the motion is a small oscillation about 
the equilibrium point. 

If damping is present, however, it is natural to expect that the amplitude of the 
motion decays in time and that the stable critical point (center) becomes an asymp¬ 
totically stable critical point (spiral point). See the phase portrait for the damped 
pendulum in Figure 9.3.5. This can almost be argued from a consideration of dV/dt. 
For the damped pendulum, the total energy is still given by Eq. (4), but now, from 
Eqs. (13) of Section 9.2 , dx/dt = y and dy/dt = —( g/L ) sinx — ( c/mL)y . Substituting 
for dx/dt and dy/dt in Eq. (5) gives dV/dt = —cLy 2 < 0. Thus the energy is nonin¬ 
creasing along any trajectory, and except for the line y = 0, the motion is such that 
the energy decreases. Hence each trajectory must approach a point of minimum 
energy—a stable equilibrium point. If dV/dt < 0 instead of dV/dt < 0, it is reason¬ 
able to expect that this would be true for all trajectories that start sufficiently close 
to the origin. 
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General Systems. To pursue these ideas further, consider the autonomous system 

dx/dt = F(x,y ), dy/dt = G(x,y ), (6) 

and suppose that the point x = 0, y = 0 is an asymptotically stable critical point. 
Then there exists some domain D containing (0,0) such that every trajectory that 
starts in D must approach the origin as t -> oo. Suppose that there exists an “energy” 
function V such that V > 0 for (x,y) in D with V = 0 only at the origin. Since each 
trajectory in D approaches the origin as t -> oo, then following any particular trajec¬ 
tory, V decreases to zero as t approaches infinity. The type of result we want to prove 
is essentially the converse: if, on every trajectory, V decreases to zero as t increases, 
then the trajectories must approach the origin as t -> oo, and hence the origin is 
asymptotically stable. First, however, it is necessary to make several definitions. 

Let V be defined on some domain D containing the origin. Then V is said to 
be positive definite on D if L(0,0) = 0 and V(x,y) > 0 for all other points in D. 
Similarly, V is said to be negative definite on D if L(0,0) = 0 and V(x,y) < 0 for all 
other points in D. If the inequalities > and < are replaced by > and <, then V is 
said to be positive semidefinite and negative semidefinite, respectively. We emphasize 
that when we speak of a positive definite (negative definite,...) function on a domain 
D containing the origin, the function must be zero at the origin in addition to satisfying 
the proper inequality at all other points in D. 


The function 


V(x,y) = sin(x 2 -by 2 ) 

is positive definite onx 2 -by 2 < n/2 since T(0,0) = 0 and V(x,y) > 0 for 0 < x 2 -by 2 < tt/2. 
However, the function 

V(x,y) = (x + yf 

is only positive semidefinite since V (x, y) = 0 on the line y = — x. 


We also want to consider the function 


V(x,y) = V x (x,y)F(x,y) + V y (x,y)G(x,y), (7) 


where F and G are the same functions as in Eqs. (6). We choose this notation 
because V(x,y) can be identified as the rate of change of V along the trajectory 
of the system (6) that passes through the point (x 9 y). That is, if x = </>(t),y = \[r(t) is 
a solution of the system (6), then 


dV[<Kt),m] 

dt 




d<t>(t) 

dt 


+ v y m),m] 


d\l/(t) 

dt 


= V x (x,y)F(x,y) + V y (x,y)G(x,y) 

= V(x,y). (8) 

The function V is sometimes referred to as the derivative of V with respect to the 
system (6). 

We now state two Liapunov theorems, the first dealing with stability, the second 
with instability. 
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Theorem 9.6.1 


Theorem 9.6.2 


Suppose that the autonomous system (6) has an isolated critical point at the ori¬ 
gin. If there exists a function V that is continuous and has continuous first partial 
derivatives, that is positive definite, and for which the function V given by Eq. (7) 
is negative definite on some domain D in the xy-plane containing (0,0), then the 
origin is an asymptotically stable critical point. If V is negative semidefinite, then 
the origin is a stable critical point. 


Let the origin be an isolated critical point of the autonomous system (6). Let V be a 
function that is continuous and has continuous first partial derivatives. Suppose that 
V (0,0) = 0 and that in every neighborhood of the origin there is at least one point 
at which V is positive (negative). If there exists a domain D containing the origin 
such that the function V given by Eq. (7) is positive definite (negative definite) on 
D, then the origin is an unstable critical point. 

The function V is called a Liapunov function. Before sketching geometrical argu¬ 
ments for Theorems 9.6.1 and 9.6.2, we note that the difficulty in using these theorems 
is that they tell us nothing about how to construct a Liapunov function, assuming that 
one exists. In cases where the autonomous system (6) represents a physical prob¬ 
lem, it is natural to consider first the actual total energy function of the system as 
a possible Liapunov function. However, Theorems 9.6.1 and 9.6.2 are applicable in 
cases where the concept of physical energy is not pertinent. In such cases a judicious 
trial-and-error approach may be necessary. 

Now consider the second part of Theorem 9.6.1—that is, the case V < 0. Let 
c > 0 be a constant, and consider the curve in the xy-plane given by V(x,y) = c. 
For c — 0 the curve reduces to the single point x = 0, y = 0. We assume that if 
0 < ci < C 2 , then the curve V(x,y) = ci contains the origin and lies within the curve 
V(x,y) = C 2 , as illustrated in Figure 9.6.1 a. We show that a trajectory starting inside 
a closed curve V (x, y) = c cannot cross to the outside. Thus, given a circle of radius 
€ about the origin, by taking c sufficiently small, we can ensure that every trajectory 
starting inside the closed curve V(x,y) = c stays within the circle of radius e; indeed, 
it stays within the closed curve V(x,y) = c itself. Thus the origin is a stable critical 
point. 

To show this, recall from calculus that the vector 

W(x,y) = V x (x,y) i + V y (x,y) j, (9) 

known as the gradient of V, is normal to the curve V (x, y) = c and points in the direc¬ 
tion of increasing V. In the present case, V increases outward from the origin, so VF 
points away from the origin, as indicated in Figure 9.6.16. Next, consider a trajectory 
x = </>(t), y = \jr(t) of the system (6), and recall that the vector T (t) = i + j 

is tangent to the trajectory at each point; see Figure 9.6.16. Let xi =0(z L 1 ),y 1 = 
be a point of intersection of the trajectory and a closed curve V(x,y) = c. At this 
point 0 / (ti) = F(xi,yi), i/r'ih) = G(xi,yi), so from Eq. (7) we obtain 

V(x uyi ) = V x (xi ,yi)<l>'(ti) + VyixuytW'ih) 

= [V x (xi,yi)i + V y {x 1 ,yi) j] • [0'(fi)i + ^'(fi)j] 

= VV(x 1 ,y 1 )-T(t 1 ). 


( 10 ) 
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V{x, y) = c 

\' 
\ 

X - </){t) 

y = \y(t) 

v x (x v yi) * + Vybi<yd J = vv 


s d(j) (q). 
dt 1 

X 

A A 

r (*i. yi)\ 



(a) ( b) 

FIGURE 9.6.1 (a) The curves V(x,y) = c\ and V(x,y) = c 2 with 0 < c\ < C 2 . 

(,b ) Geometrical interpretation of Liapunov’s second method. 


Thus V(xi,yi) is the scalar product of the vector W(xi,yi) and the vector 
T(q). Since V(xi,yi) < 0, it follows that the cosine of the angle between VU(xi,yi) 
and T(q) is also less than or equal to zero; hence the angle itself is in the range 
[jt/2, 3tt/2]. Thus the direction of motion on the trajectory is inward with respect to 
V(xi,yi) = c or, at worst, tangent to this curve. Trajectories starting inside a closed 
curve V(xi,yi) = c (no matter how small c is) cannot escape, so the origin is a sta¬ 
ble point. If V(xi,yi) < 0, then the trajectories passing through points on the curve 
are actually pointed inward. As a consequence, it can be shown that trajectories 
starting sufficiently close to the origin must approach the origin; hence the origin is 
asymptotically stable. 

A geometrical argument for Theorem 9.6.2 follows in a somewhat similar manner. 
Briefly, suppose that V is positive definite, and suppose that given any circle about the 
origin, there is an interior point (Jti,yi) at which V(xi,yi) > 0. Consider a trajectory 
that starts at (Jti,yi). It follows from Eq. (8) that along this trajectory, V must increase 
since V(xi,yi) > 0; furthermore, since V(x\,y\) > 0, the trajectory cannot approach 
the origin because U(0,0) = 0. This shows that the origin cannot be asymptotically 
stable. By further exploiting the fact that V(x,y) > 0, it is possible to show that the 
origin is an unstable point; however, we will not pursue this argument. 

Use Theorem 9.6.1 to show that (0,0) is a stable critical point for the undamped pendulum 
equations (2). Also use Theorem 9.6.2 to show that (tt, 0) is an unstable critical point. 

Let V be the total energy given by Eq. (4): 

V(x,y) = mgL( 1 — cosx) + \mL 2 y 2 . (4) 

If we take D to be the domain —n/2 < x < 7 t / 2 , — 00 < y < 00, then V is positive there 
except at the origin, where it is zero. Thus V is positive definite on D. Further, as we have 
already seen, 

V = (mgL sin x)(y) + (mL 2 y)(—g sin x)/L = 0 

for all x and y. Thus V is negative semidefinite on D. Consequently, by the last statement 
in Theorem 9.6.1, the origin is a stable critical point for the undamped pendulum. Observe 
that this conclusion cannot be obtained from Theorem 9.3.2 because (0,0) is a center for the 
corresponding linear system. 
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Now consider the critical point (jt, 0). The Liapunov function given by Eq. (4) is no longer 
suitable because Theorem 9.6.2 calls for a function V for which V is either positive or negative 
definite. To analyze the point (7r,0), it is convenient to move this point to the origin by the 
change of variables x = jt + u, y = v. Then the differential equations (2) become 

g 

du/dt = v , dv/dt = — sin u, (11) 

and the critical point is (0,0) in the uv- plane. Consider the function 

V(u,v) = vsinu (12) 

and let D be the domain —7r/4 < u < 7t/4, —oo < v < oo. Then 

V = (vcosu)(v) + (sin u)[(g/L) sin w] = v 2 cos u + (g/L) sin 2 u (13) 

is positive definite in D. The only remaining question is whether there are points in every 
neighborhood of the origin where V itself is positive. From Eq. (12) we see that V ( u , v) > 0 
in the first quadrant (where both sin u and v are positive) and in the third quadrant (where 
both are negative). Thus the conditions of Theorem 9.6.2 are satisfied, and the point (0,0) in 
the wu-plane, corresponding to the point (tt, 0) in the xy-plane, is unstable. 

The damped pendulum equations are discussed in Problem 7. 


From a practical point of view, we are often interested in the basin of attraction. 
The following theorem provides some information on this subject. 


Theorem 9.6.3 Let the origin be an isolated critical point of the autonomous system (6). Let the 
function V be continuous and have continuous first partial derivatives. If there is a 
bounded domain Dk containing the origin where V (x, y) < K for some positive K , 
V is positive definite, and V is negative definite, then every solution of Eqs. (6) that 
starts at a point in D K approaches the origin as t approaches infinity. 


In other words, Theorem 9.6.3 says that if x = 0(0, y = VK0 is the solution of 
Eqs. (6) for initial data lying in Dk, then (x,y) approaches the critical point (0,0) as 
t oo. Thus D k gives a region of asymptotic stability; of course, it may not be the 
entire basin of attraction. This theorem is proved by showing that (i) there are no 
periodic solutions of the system (6) in Dk, and (ii) there are no other critical points 
in Dk- It then follows that trajectories starting in D K cannot escape and therefore 
must tend to the origin as t tends to infinity. 

Theorems 9.6.1 and 9.6.2 give sufficient conditions for stability and instability, 
respectively, but these conditions are not necessary. Also, our failure to find a suit¬ 
able Liapunov function does not mean that there is no such function. Unfortunately, 
there are no general methods for the construction of Liapunov functions; how¬ 
ever, there has been extensive work on the construction of Liapunov functions for 
special classes of equations. An elementary algebraic result that is often useful in 
constructing positive definite or negative definite functions is stated without proof 
in the following theorem. 
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Theorem 9.6.4 


EXAMPLE 

3 


EXAMPLE 

4 


The function 


V (x, y) = ax 2 + bxy + cy 2 

(14) 

is positive definite if, and only if, 


a > 0 and 4<?c — b 2 > 0 

(15) 

and is negative definite if, and only if, 


a < 0 and 4^c — b 2 > 0. 

(16) 


The use of Theorem 9.6.4 is illustrated in the following example. 


Show that the critical point (0,0) of the autonomous system 

dx/dt = —x — xy 2 , dy/dt = — y — x 2 y (17) 

is asymptotically stable. 

We try to construct a Liapunov function of the form (14). Then V x (x,y) =2ax + by, 
V y (x,y) = bx + 2cy, so 

V(x,y) = (lax + by)(—x — xy 2 ) + (bx + 2cy)(—y — x 2 y) 

= - [2a(x 2 + x 2 y 2 ) + b(2xy + xy 3 + x 3 y) + 2 c(y 2 + x 2 y 2 )]. 

If we choose b = 0, and a and c to be any positive numbers, then V is negative definite and V 
is positive definite by Theorem 9.6.4. Thus, by Theorem 9.6.1, the origin is an asymptotically 
stable critical point. 


Consider the system 


dx/dt = x(l — x — y), 
dy/dt = y(0.75 — y — 0.5x). 


(18) 


In Example 1 of Section 9.4, we found that this system models a certain pair of competing 
species and that the critical point (0.5,0.5) is asymptotically stable. Confirm this conclusion by 
finding a suitable Liapunov function. 

It is helpful to transform the point (0.5,0.5) to the origin. To this end, let 

x = 0.5 + u, y = 0.5 + v. (19) 

Then, substituting for x and y in Eqs. (18), we obtain the new system 


du/dt = — 0.5u — 0.5d — u 2 — uv , 
dv/dt = —0.25 u — 0.5d — 0.5 uv — v 2 . 


( 20 ) 


To keep the calculations relatively simple, consider the function V (w, v) = u 2 + v 2 as a possible 
Liapunov function. This function is clearly positive definite, so we need only to determine 
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PROBLEMS 


whether there is a region containing the origin in the uv -plane where the derivative V with 
respect to the system (20) is negative definite. We compute V ( u , v) and find that 


du dv 
V(u,v) = V u - + V v - 


= 2u(—0.5u — 0.5i; — u 2 


uv) + 2a(—0.25 u — 0.5a — 0.5 uv — a * 1 2 ), 


or 

V ( u , a) = — “I - 1.5wa 4- a 2 ) + (2 u 3 4 + 2u 2 v + uv 2 + 2a 2 )J, (21) 

where we have collected together the quadratic and cubic terms. We want to show that the 
expression in square brackets in Eq. (21) is positive definite, at least for u and a sufficiently 
small. Observe that the quadratic terms can be written as 

u 2 + 1.5uv + a 2 = 0.25 (u 2 + a 2 ) + 0.15(u + a) 2 , (22) 

so these terms are positive definite. On the other hand, the cubic terms in Eq. (21) may be of 
either sign. Thus we must show that, in some neighborhood of u = 0, a = 0, the cubic terms 
are smaller in magnitude than the quadratic terms; that is, 

\2u 3 + 2u 2 v + uv 2 + 2a 3 1 < 0.25(w 2 + a 2 ) + 0.15(u + a) 2 . (23) 

To estimate the left side of Eq. (23), we introduce polar coordinates u = rcos0, a = rsin0. 
Then 


\2u 3 + 2u 2 v + uv 2 + 2a 3 1 = r 3 12 cos 3 6 + 2 cos 2 6 sin 6 + cos 6 sin 2 6 + 2 sin 3 6 \ 

< r 3 [21 cos 3 6\ + 2 cos 2 6\ sin#| + | cos0| sin 2 6 + 2\ sin 3 0|] 

< 7r 3 , 

since | sin0|, | cos0| < 1. To satisfy Eq. (23), it is now certainly sufficient to satisfy the more 
stringent requirement 

lr 3 < 0.25 (u 2 + a 2 ) = 0.25r 2 = \r 2 , 

which yields r < 1/28. Thus, at least in this disk, the hypotheses of Theorem 9.6.1 are satisfied, 
so the origin is an asymptotically stable critical point of the system (20). The same is then true 
of the critical point (0.5,0.5) of the original system (18). 

If we refer to Theorem 9.6.3, the preceding argument also shows that the disk with center 
(0.5,0.5) and radius 1/28 is a region of asymptotic stability for the system (18). This is a 
severe underestimate of the full basin of attraction, as the discussion in Section 9.4 shows. 
To obtain a better estimate of the actual basin of attraction from Theorem 9.6.3, we would 
have to estimate the terms in Eq. (23) more accurately, or use a better (and presumably more 
complicated) Liapunov function, or both. 


In each of Problems 1 through 4, construct a suitable Liapunov function of the form ax 2 + cy 2 , 
where a and c are to be determined. Then show that the critical point at the origin is of the 
indicated type. 

1. dx/dt = —x 3 + xy 2 , dy/dt = —2x 2 y — y 3 ; asymptotically stable 

2. dx/dt = — \x 3 + 2xy 2 , dy/dt = — y 3 ; asymptotically stable 

3. dx/dt = —x 3 + 2 y 3 , dy/dt = —2xy 2 ; stable (at least) 

4. dx/dt = x 3 — y 3 , dy/dt = 2xy 2 + 4x 2 y + 2 y 3 ; unstable 
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5. Consider the system of equations 


dx/dt = y — x/(x,y), dy/dt = — x — yf(x,y ), 


where / is continuous and has continuous first partial derivatives. Show that if/(x,y) > 0 
in some neighborhood of the origin, then the origin is an asymptotically stable critical 
point, and that if f(x,y) < 0 in some neighborhood of the origin, then the origin is an 
unstable critical point. 

Hint: Construct a Liapunov function of the form c(x 2 + y 2 ). 

6. A generalization of the undamped pendulum equation is 


d 2 u/dt 2 + g(u) = 0, 


(i) 


where g(0) = 0, g(u) > 0 for 0 < u < k, and g(u) < 0 for —k < u < 0; that is, ug(u) > 0 
for u ^ 0, — k < u < k. Notice that g(u) = sin u has this property on (—7r/2, jt/2). 

(a) Letting x = u,y = du/dt , write Eq. (i) as a system of two equations, and show that 
x = 0, y = 0 is a critical point. 

(b) Show that 



(ii) 


—k < x < k 


is positive definite, and use this result to show that the critical point (0,0) is stable. 
Note that the Liapunov function V given by Eq. (ii) corresponds to the energy function 
V(x,y) = \y 2 + (1 — cos x) for the case g(u) = sin u. 

7. By introducing suitable dimensionless variables, we can write the system of nonlinear 
equations for the damped pendulum [Eqs. (8) of Section 9.3] as 


dx/dt = y, dy/dt = — y — sinx. 


(a) Show that the origin is a critical point. 

(b) Show that although V (x, y) = x 2 + y 2 is positive definite, V (x, y) takes on both positive 
and negative values in any domain containing the origin, so V is not a Liapunov function. 
Hint: x — sinx > 0 for x > 0, and x — sinx < 0 for x < 0. Consider these cases with y 
positive but y so small that y 2 can be ignored compared to y. 

(c) Using the energy function V(x,y) = \y 2 + (1 — cosx) mentioned in Problem 6(b), 
show that the origin is a stable critical point. Since there is damping in the system, we 
can expect that the origin is asymptotically stable. However, it is not possible to draw this 
conclusion using this Liapunov function. 

(d) To show asymptotic stability, it is necessary to construct a better Liapunov function 
than the one used in part (c). Show that V(x,y) = \ (x + y) 2 + x 2 + \y 2 is such a Liapunov 
function, and conclude that the origin is an asymptotically stable critical point. 

Hint: From Taylor’s formula with a remainder, it follows that sinx = x — ax 3 / 3!, where a 
depends on x but 0 < a < 1 for — n/l < x < n/2. Then, letting x = r cos 0,y = r sin 0, show 
that V (r cos 0 , r sin 6) = —r 2 [ 1 + h(r, 0)], where \h(r, 0) \ < 1 if r is sufficiently small. 

8. The Lienard equation (Problem 30 of Section 9.3) is 



where g satisfies the conditions of Problem 6 and c(u) > 0. Show that the point u — 0, 
du/dt = 0 is a stable critical point. 
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9. (a) A special case of the Lienard equation of Problem 8 is 


d 2 u du 
dt 2 + dt 


+ g(u) = 0, 


where g satisfies the conditions of Problem 6. Letting x = u, y = du/dt , show that the 
origin is a critical point of the resulting system. This equation can be interpreted as describ¬ 
ing the motion of a spring-mass system with damping proportional to the velocity and a 
nonlinear restoring force. Using the Liapunov function of Problem 6, show that the origin 
is a stable critical point, but note that even with damping, we cannot conclude asymptotic 
stability using this Liapunov function. 

(b) Asymptotic stability of the critical point (0,0) can be shown by constructing a better 
Liapunov function, as was done in part (d) of Problem 7. However, the analysis for a 
general function g is somewhat sophisticated, and we mention only that an appropriate 
form for V is 


V(x,y) = iy 2 + 


Ayg(x)+ f g(s) ds, 
Jo 


where A is a positive constant to be chosen so that V is positive definite and V is negative 
definite. For the pendulum problem g(x) = sinx, use V as given by the preceding equation 
with A = \ to show that the origin is asymptotically stable. 

Hint: Use sinx = x — ax 3 /3! and cosx = 1 — /ix 2 /2!, where a and ft depend on x, and 
0 < a < 1 and 0 < fi < 1 for —n/2 < x < 7r/2; let x = rcosO, y = rsinO , and show 
that V(r cos 0,r sin 0) = —\r\ 1 + \ sin 20 + h(r,6)], where \h(r,0)\ < \ if r is sufficiently 
small. To show that V is positive definite, use cosx = 1 — x 2 /2 + yx 4 / 4!, where y depends 
on x, and 0 < y < 1 for — 7t/2 < x < n/2. 


In Problems 10 and 11, we will prove part of Theorem 9.3.2: If the critical point (0,0) of the 
locally linear system 


dx/dt = a\\X + any + F\ (x,y), dy/dt = a 2 \X + a 22 y + Gi(x,y) (i) 


is an asymptotically stable critical point of the corresponding linear system 


dx/dt — a\\x + a\ 2 y, dy/dt = a 2 \x + a 22 y , (ii) 

then it is an asymptotically stable critical point of the locally linear system (i). Problem 12 
deals with the corresponding result for instability. 

10. Consider the linear system (ii). 

(a) Since (0,0) is an asymptotically stable critical point, show that an + a 22 < 0 and 
aua 2 2 ~ 012^21 > 0. (See Problem 21 of Section 9.1.) 

(b) Construct a Liapunov function V (x, y) = Ax 2 + Bxy + Cy 2 such that V is positive 
definite and V is negative definite. One way to ensure that V is negative definite is to 
choose A, B, and C so that V (x,y) = —x 2 — y 2 . Show that this leads to the result 

ai-, + ai ? + (# 11*222 — #i 2 # 2 i) n # 12^22 + #n# 2 i 

A = ——-—-, B = -, 

2A A 

^ _ a\i + a \2 + (011022 - 012021 ) 

2A 


where A = (an + # 22 )(#n #22 — #i 2 # 2 i)- 
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(c) Using the result of part (a), show that A > 0, and then show (several steps of algebra 
are required) that 

„ d2 («ii + a\ 2 + 02i + al 2 )(a n a 2 2 ~ 012021 ) + 2(0n0 22 - 012021) 2 n 

4/iC — n = --- > U. 

A 2 

Thus, by Theorem 9.6.4, V is positive definite. 

11. In this problem we show that the Liapunov function constructed in the preceding problem 
is also a Liapunov function for the locally linear system (i). We must show that there is 
some region containing the origin for which V is negative definite. 

(a) Show that 

V(x,y) = -{x 2 +y 2 ) + (2 Ax + By)F 1 (x,y) + ( Bx + 2Cy)Gi(x,y). 

(b) Recall that F\(x,y)/r -> 0 and G\(x,y)/r -> 0 as r = (x 2 + y 2 ) 1/2 0 . This means 

that, given any e > 0, there exists a circle r = R about the origin such that for 0 < r < R, 
\Fi(x,y)\ < er and \ G\(x,y)\ < er. Letting M be the maximum of \2A\,\B\, and |2C|,show 
by introducing polar coordinates that R can be chosen so that V(x,y) < 0 for r < R. 
Hint: Choose e sufficiently small in terms of M. 

12. In this problem we prove a part of Theorem 9.3.2 related to instability. 

(a) Show that if an + a 22 > 0 and 011022 — 012021 > 0, then the critical point (0,0) of the 
linear system (ii) is unstable. 

(b) The same result holds for the locally linear system (i). As in Problems 10 and 11, 
construct a positive definite function V such that V (x, y) = x 2 + y 2 and hence is positive 
definite, and then invoke Theorem 9.6.2. 


9.7 Periodic Solutions and Limit Cycles 


In this section we discuss further the possible existence of periodic solutions of two- 
dimensional autonomous systems 

x' = f(x). (1) 


Such solutions satisfy the relation 


x(r +T) = x(0 (2) 

for all t and for some positive constant T called the period. The corresponding 
trajectories are closed curves in the phase plane. Periodic solutions often play an 
important role in physical problems because they represent phenomena that occur 
repeatedly. In many situations a periodic solution represents a “final state” that 
is approached by all “neighboring” solutions as the transients due to the initial 
conditions die out. 

A special case of a periodic solution is a constant solution x = x°, which corresponds 
to a critical point of the autonomous system. Such a solution is clearly periodic 
with any period. In this section, when we speak of a periodic solution, we mean 
a nonconstant periodic solution. In this case the period T is usually chosen as the 
smallest positive number for which Eq. (2) is valid. 
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Recall that the solutions of the linear autonomous system 

x' = Ax (3) 

are periodic if and only if the eigenvalues of A are pure imaginary. In this case the 
critical point at the origin is a center, as discussed in Section 9.1. We emphasize 
that if the eigenvalues of A are pure imaginary, then every solution of the linear 
system (3) is periodic, while if the eigenvalues are not pure imaginary, then there 
are no (nonconstant) periodic solutions. The predator-prey equations discussed in 
Section 9.5, although nonlinear, behave similarly: all solutions in the first quadrant 
are periodic. The following example illustrates a different way in which periodic 
solutions of nonlinear autonomous systems can occur. 


EXAMPLE 

1 


Discuss the solutions of the system 



( x + y- x(x 2 + y 2 )\ 
-x + y- y(x 2 + y 2 ) J 


( 4 ) 


It is not difficult to show that (0,0) is the only critical point of the system (4) and also that 
the system is locally linear in the neighborhood of the origin. The corresponding linear system 



( 5 ) 


has eigenvalues 1 ± i. Therefore, the origin is an unstable spiral point for both the linear 
system (5) and the nonlinear system (4). Thus any solution that starts near the origin in the 
phase plane will spiral away from the origin. Since there are no other critical points, we might 
think that all solutions of Eqs. (4) correspond to trajectories that spiral out to infinity. However, 
we now show that this is incorrect, because far away from the origin the trajectories are directed 
inward. 

It is convenient to introduce polar coordinates r and 0, where 


x — r cos 6 , y — r sin 0, 


( 6 ) 


and r > 0. If we multiply the first of Eqs. (4) by x, multiply the second by y, and add, we then 
obtain 

X lt + y ~dt = + ^ ^ + y2)2 ' 

Since r 2 = x 2 + y 2 and r (dr/dt ) = x(dx/dt) + y(dy/dt), it follows from Eq. (7) that 

dr 0 M ~ 

r—=r 2 (l-r 2 ). (8) 


This equation is similar to the equations discussed in Section 2.5. The critical points (for r > 0) 
are the origin and the point r = 1, which corresponds to the unit circle in the phase plane. 
From Eq. (8) it follows that dr/dt > 0 if r < 1 and dr/dt < 0 if r > 1. Thus, inside the unit 
circle the trajectories are directed outward, while outside the unit circle they are directed 
inward. Apparently, the circle r = 1 is a limiting trajectory for this system. 

To determine an equation for 0 , we multiply the first of Eqs. (4) by y, multiply the second 
by x, and subtract, obtaining 


dx dy 7 7 

y T,- x T,= x +y ' 


( 9 ) 
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Upon calculating dx/dt and dy/dt from Eqs. (6) and simplifying, we find that the left side of 
Eq. (9) is - r 2 (d0/dt ), so Eq. (9) reduces to 


dO 

dt 


= - 1 . 


( 10 ) 


The system of equations (8), (10) for r and 0 is equivalent to the original system (4). One 
solution of the system (8), (10) is 


r — 1, Q = —t + to, 


( 11 ) 


where to is an arbitrary constant. As t increases, a point satisfying Eqs. (11) moves clockwise 
around the unit circle. Thus the autonomous system (4) has a periodic solution. Other solutions 
can be obtained by solving Eq. (8) by separation of variables; if r ^ 0 and r ^ 1, then 


dr 

r( 1 — r 2 ) 


= dt. 


( 12 ) 


Equation (12) can be solved by using partial fractions to rewrite the left side and then inte¬ 
grating. By performing these calculations, we find that the solution of Eqs. (10) and (12) is 


1 

yjl + Coe ~ 2t ’ 


0 — —t + to , 


(13) 


where c 0 and t 0 are arbitrary constants. The solution (13) also contains the solution (11), which 
is obtained by setting Co = 0 in the first of Eqs. (13). 

The solution satisfying the initial conditions r = p, 6 = a at t = 0 is given by 


1 

/L + [a/p 2 )-rF^’ 


0 = -(t- a). 


(14) 


Up < 1, then r 1 from the inside as t oo; if p > 1, then r 1 from the outside as t oo. 
Thus in all cases, the trajectories spiral toward the circle r = 1 as t oo. Several trajectories 
are shown in Figure 9.7.1. 



FIGURE 9.7.1 Trajectories of the system (4); the circle r = 1 is a limit cycle. 
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In this example, the circle r — 1 not only corresponds to periodic solutions of 
the system (4), but it also attracts other nonclosed trajectories that spiral toward it 
as t -> oo. In general, a closed trajectory in the phase plane such that other non¬ 
closed trajectories spiral toward it, from either the inside or the outside, as t -> oo, 
is called a limit cycle. Thus the circle r = 1 is a limit cycle for the system (4). If 
all trajectories that start near a closed trajectory (both inside and outside) spiral 
toward the closed trajectory as t ^ oo, then the limit cycle is asymptotically stable. 
Since the limiting trajectory is itself a periodic orbit rather than an equilibrium point, 
this type of stability is often called orbital stability. If the trajectories on one side 
spiral toward the closed trajectory, while those on the other side spiral away as t oo, 
then the limit cycle is said to be semistable. If the trajectories on both sides of the 
closed trajectory spiral away as t -> oo, then the closed trajectory is unstable. It is 
also possible to have closed trajectories that other trajectories neither approach nor 
depart from—for example, the periodic solutions of the predator-prey equations in 
Section 9.5. In this case the closed trajectory is stable. 

In Example 1 the existence of an asymptotically stable limit cycle was established 
by solving the equations explicitly. Unfortunately, this is usually not possible, so it 
is worthwhile to know general theorems concerning the existence or nonexistence 
of limit cycles of nonlinear autonomous systems. In discussing these theorems, it is 
convenient to rewrite the system (1) in the scalar form 

dx/dt = F(x,y ), dy/dt = G(x,y). (15) 


Theorem 9.7.1 Let die f unc ti° ns F and G have continuous first partial derivatives in a domain D 
of the xy-plane. A closed trajectory of the system (15) must necessarily enclose at 
least one critical (equilibrium) point. If it encloses only one critical point, the critical 
point cannot be a saddle point. 


Although we omit the proof of this theorem, it is easy to show examples of it. 
One is given by Example 1 and Figure 9.7.1, in which the closed trajectory encloses 
the critical point (0,0), a spiral point. Another example is the system of predator- 
prey equations in Section 9.5; see Figure 9.5.2. Each closed trajectory surrounds the 
critical point (3,2); in this case the critical point is a center. 

Theorem 9.7.1 is also useful in a negative sense. If a given region contains no 
critical points, then there can be no closed trajectory lying entirely in the region. The 
same conclusion is true if the region contains only one critical point, and this point 
is a saddle point. For instance, in Example 2 of Section 9.4, which deals with two 
competing species, the only critical point in the interior of the first quadrant is the 
saddle point (0.5,0.5). Therefore, this system has no closed trajectory lying in the first 
quadrant. 

A second result about the nonexistence of closed trajectories is given in the 
following theorem. 


Theorem 9.7.2 Let die functions F and G have continuous first partial derivatives in a simply 
connected domain D of the xy-plane. If F x + G y has the same sign throughout D, 
then there is no closed trajectory of the system (15) lying entirely in D. 
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A simply connected two-dimensional domain is one with no holes. Theorem 9.7.2 
is a straightforward consequence of Green’s theorem in the plane; see Problem 13. 
Note that if F x + G y changes sign in the domain, then no conclusion can be drawn; 
there may or may not be closed trajectories in D. 

To illustrate Theorem 9.7.2, consider the system (4). A routine calculation 

shows that _ 

F x (x,y) + G y (x,y ) = 2 - 4(x 2 + y 2 ) = 2(1 - 2r 2 ), (16) 

where, as usual, r 2 = x 2 + y 2 . Hence F x + G y is positive for 0 < r < l/\/2, so there 
is no closed trajectory in this circular disk. Of course, we showed in Example 1 that 
there is no closed trajectory in the larger region r < 1. This illustrates that the infor¬ 
mation given by Theorem 9.7.2 may not be the best possible result. Again referring 
to Eq. (16), note that F x + G y < 0 for r > 1/V2. However, the theorem is not appli¬ 
cable in this case because this annular region is not simply connected. Indeed, as 
shown in Example 1, it does contain a limit cycle. 

The following theorem gives conditions that guarantee the existence of a closed 
trajectory. 

Theorem 9.7.3 (Poincare-Bendixson 11 Theorem) 

Let the functions F and G have continuous first partial derivatives in a domain D 
of the xy-plane. Let D\ be a bounded subdomain in D, and let R be the region that 
consists of D\ plus its boundary (all points of R are in D ). Suppose that R contains 
no critical point of the system (15). If there exists a constant to such that x = 0(0, 
y = 0(0 is a solution of the system (15) that exists and stays in R for all t > to, 
then either x = 0(0, y = 0(0 is a periodic solution (closed trajectory), or x = 0(0, 
y = 0(0 spirals toward a closed trajectory as t -> oc. In either case, the system (15) 
has a periodic solution in R. 

Note that if R does contain a closed trajectory, then necessarily, by Theorem 9.7.1, 
this trajectory must enclose a critical point. However, this critical point cannot be in 
R . Thus R cannot be simply connected; it must have a hole. 

As an application of the Poincare-Bendixson theorem, consider again the system 
(4). Since the origin is a critical point, it must be excluded. For instance, we can 
consider the region R defined by 0.5 < r < 2. Next, we must show that there is a 
solution whose trajectory stays in R for all t greater than or equal to some to . This 
follows immediately from Eq. (8). For r = 0.5, dr/dt > 0, so r increases, while for 
r = 2, dr/dt < 0, so r decreases. Thus any trajectory that crosses the boundary of R 
is entering R. Consequently, any solution of Eqs. (4) that starts in R at t = to cannot 
leave but must stay in R for t > to. Of course, other numbers could be used instead 
of 0.5 and 2; all that is important is that r = 1 is included. 

One should not infer from this discussion of the preceding theorems that it is 
easy to determine whether a given nonlinear autonomous system has periodic solu¬ 
tions; often it is not a simple matter at all. Theorems 9.7.1 and 9.7.2 are frequently 
inconclusive, and for Theorem 9.7.3 it is often difficult to determine a region R and 
a solution that always remains within it. 


n Ivar Otto Bendixson (1861-1935) a Swedish mathematician, received his doctorate from Uppsala 
University and was professor and for many years rector of Stockholm University. This theorem improved 
on an earlier result of Poincare and was published in a paper by Bendixson in Acta Mathematica in 1901. 
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EXAMPLE 

2 


We close this section with another example of a nonlinear system that has a limit 
cycle. 

The van der Pol 12 equation 

u" — /x(l — u 2 )u' + u = 0, (17) 

where /x is a nonnegative constant, describes the current u in a triode oscillator. Discuss the 
solutions of this equation. 

If /x = 0, Eq. (17) reduces to u" + u = 0, whose solutions are sine or cosine waves of period 
2jt. For /x > 0, the second term on the left side of Eq. (17) must also be considered. This is the 
resistance term, proportional to u ', with a coefficient —/x( 1 — u 2 ) that depends on u. For large 
u , this term is positive and acts as usual to reduce the amplitude of the response. However, for 
small u , the resistance term is negative and so causes the response to grow. This suggests that 
perhaps there is a solution of intermediate size that other solutions approach as t increases. 

To analyze Eq. (17) more carefully, we write it as a system of two equations by introducing 
the variables x = u,y = u'. Then it follows that 

x' =y, y' = ~ x + m( 1 * 2 )y• (18) 

The only critical point of the system (18) is the origin. Near the origin the corresponding linear 
system is 



whose eigenvalues are (/x ± ^//x 2 — 4)/2. Thus the origin is an unstable spiral point for 
0 < /x < 2 and an unstable node for /x > 2. In all cases, a solution that starts near the origin 
grows as t increases. 

With regard to periodic solutions, Theorems 9.7.1 and 9.7.2 provide only partial informa¬ 
tion. From Theorem 9.7.1 we conclude that if there are closed trajectories, they must enclose 
the origin. Next we calculate F x (pc,y) + G y (x,y), with the result that 

F x (x,y) + G y (x,y) = ii(l - x 2 ). (20) 

Then it follows from Theorem 9.7.2 that closed trajectories, if there are any, are not contained 
in the strip |x| < 1 where F x + G y > 0. 

The application of the Poincare-Bendixson theorem to this problem is not nearly as simple 
as for Example 1. If we introduce polar coordinates, we find that the equation for the radial 
variable r is 

r' = /x(l — r 2 cos 2 6)r sin 2 0. (21) 

Again, consider an annular region R given by r\ < r < r 2 , where r\ is small and r 2 is large. 
When r = ru the linear term on the right side of Eq. (21) dominates, and r' > 0 except on 
the x-axis, where sin 6 = 0 and consequently r' = 0 also. Thus trajectories are entering R at 
every point on the circle r = r\, except possibly for those on the x-axis, where the trajecto¬ 
ries are tangent to the circle. When r = r 2 , the cubic term on the right side of Eq. (21) is 
the dominant one. Thus r' < 0, except for points on the x-axis where r' = 0 and for points 
near the y-axis where r 2 cos 2 0 < 1 and the linear term makes r' > 0. Thus, no matter how 
large a circle is chosen, there will be points on it (namely, the points on or near the y-axis) 
where trajectories are leaving R. Therefore, the Poincare-Bendixson theorem is not applicable 
unless we consider more complicated regions. 


12 Balthasar van der Pol (1889-1959) was a Dutch physicist and electrical engineer who worked at the 
Philips Research Laboratory in Eindhoven. He was a pioneer in the experimental study of nonlinear 
phenomena and investigated the equation that bears his name in a paper published in 1926. 
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It is possible to show, by a more intricate analysis, that the van der Pol equation does have a 
unique limit cycle. However, we will not follow this line of argument further. We turn instead 
to a different approach in which we plot numerically computed approximations to solutions. 
Experimental observations indicate that the van der Pol equation has an asymptotically stable 
periodic solution whose period and amplitude depend on the parameter /x. By looking at 
graphs of trajectories in the phase plane and of u versus t , we can gain some understanding of 
this periodic behavior. 

Figure 9.7.2 shows two trajectories of the van der Pol equation in the phase plane for 
/x — 0.2. The trajectory starting near the origin spirals outward in the clockwise direction; 
this is consistent with the behavior of the linear approximation near the origin. The other 
trajectory passes through (—3,2) and spirals inward, again in the clockwise direction. 
Both trajectories approach a closed curve that corresponds to a stable periodic solution. In 
Figure 9.7.3 we show the plots of u versus t for the solutions corresponding to the trajectories 
in Figure 9.7.2. The solution that is initially smaller gradually increases in amplitude, while 
the larger solution gradually decays. Both solutions approach a stable periodic motion that 
corresponds to the limit cycle. Figure 9.7.3 also shows that there is a phase difference between 
the two solutions as they approach the limit cycle. The plots of u versus t are nearly sinusoidal 
in shape, consistent with the nearly circular limit cycle in this case. 



FIGURE 9.7.2 Trajectories of the van der Pol equation (17) for /x = 0.2. 



FIGURE 9.7.3 Plots of u versus t for the trajectories in Figure 9.7.2. 
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Figures 9.7.4 and 9.7.5 show similar plots for the case /x = 1. Trajectories again move clock¬ 
wise in the phase plane, but the limit cycle is considerably different from a circle. The plots 
of u versus t tend more rapidly to the limiting oscillation, and again show a phase difference. 
The oscillations are somewhat less symmetric in this case, rising somewhat more steeply than 
they fall. 



FIGURE 9.7.4 Trajectories of the van der Pol equation (17) for /x = 1. 



FIGURE 9.7.5 Plots of u versus t for the trajectories in Figure 9.7.4. 


Figure 9.7.6 shows the phase plane for /x = 5. The motion remains clockwise, and the limit 
cycle is even more elongated, especially in the y direction. Figure 9.7.7 is a plot of u versus t. 
Although the solution starts far from the limit cycle, the limiting oscillation is virtually reached 
in a fraction of a period. Starting from one of its extreme values on the x-axis in the phase 
plane, the solution moves toward the other extreme position slowly at first, but once a certain 
point on the trajectory is reached, the remainder of the transition is completed very swiftly. 
The process is then repeated in the opposite direction. The waveform of the limit cycle, as 
shown in Figure 9.7.7, is quite different from a sine wave. 
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FIGURE 9.7.6 Trajectories of the van der Pol equation (17) for /x = 5. 



FIGURE 9.7.7 Plot of u versus t for the outward spiralling trajectory in Figure 9.7.6. 


These graphs clearly show that in the absence of external excitation, the van der Pol 
oscillator has a certain characteristic mode of vibration for each value of /x. The graphs of 
u versus t show that the amplitude of this oscillation changes very little with /x, but the period 
increases as /x increases. At the same time, the waveform changes from one that is very nearly 
sinusoidal to one that is much less smooth. 

The presence of a single periodic motion that attracts all (nearby) solutions—that is, an 
asymptotically stable limit cycle—is one of the characteristic phenomena associated with 
nonlinear differential equations. 
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PROBLEMS In each of Problems 1 through 6, an autonomous system is expressed in polar coordinates. 

Determine all periodic solutions, all limit cycles, and the stability characteristics of all peri¬ 
odic solutions. 

1. dr/dt = r 2 (l — r 2 ), dO/dt = 1 2. dr/dt = r(l — r) 2 , d6/dt = —1 

3. dr/dt = r(r — l)(r — 3), dO/dt = 1 4. dr/dt = r(l — r)(r— 2), dO/dt = —1 

5. dr/dt = sin 7rr, dO/dt = 1 

6. dr/dt = r|r — 2|(r — 3), d0/dt = —1 

7. Ifx = rcos(9,y = r sin 0, show that y(dx/dt) — x(dy/dt) = —r 2 (d0/dt). 

8. (a) Show that the system 

dx/dt = — y + x/(r)/r, dy/dt = x + y/(r)/r 

has periodic solutions corresponding to the zeros of/(r). What is the direction of motion 
on the closed trajectories in the phase plane? 

(b) Let /(r) = r(r — 2) 2 (r 2 — 4r + 3). Determine all periodic solutions, and determine 
their stability characteristics. 

9. Determine the periodic solutions, if any, of the system 


dx 

Tt =y + 


\A 2 + r 


: (x 2 + y 2 — 2), 


dy 

—— = —x + 
dt 


\A 2 + r 


:(X 2 +/-2). 


10. Using Theorem 9.7.2, show that the linear autonomous system 


dx/dt = flux + 0 i 2 y, dy/dt = a 2 1 * + a 22 y 

does not have a periodic solution (other than x = 0, y = 0) if an + a 2 2 ^ 0. 

In each of Problems 11 and 12, show that the given system has no periodic solutions other than 
constant solutions. 

11. dx/dt = x + y + x 3 — y 2 , dy/dt = —x + 2 y + x 2 y + y 3 /3 

12. dx/dt = —2x — 3y — xy 2 , dy/dt = y + x 3 — x 2 y 

13. Prove Theorem 9.7.2 by completing the following argument. According to Green’s the¬ 
orem in the plane, if C is a sufficiently smooth simple closed curve, and if F and G are 
continuous and have continuous first partial derivatives, then 

J [F(x,y) dy - G(x,y ) dx] = JJ [F x (x,y) + G v (x, y)] dA, 

where C is traversed counterclockwise and R is the region enclosed by C. Assume that 
x = 0(t),y = ^r(t) is a solution of the system (15) that is periodic with period T. Let C be 
the closed curve given by x = 0(t), y = ^(0 for 0 < t < T. Show that for this curve, the 
line integral is zero. Then show that the conclusion of Theorem 9.7.2 must follow. 

14. (a) By examining the graphs of u versus t in Figures 9.7.3, 9.7.5, and 9.7.7, estimate the 
period T of the van der Pol oscillator in these cases. 

(b) Calculate and plot the graphs of solutions of the van der Pol equation for other values 
of the parameter /x. Estimate the period T in these cases also. 

(c) Plot the estimated values of T versus /x. Describe how T depends on /x. 
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15. The equation 

u" — /x(l — | u' 2 )u' + u = 0 
is often called the Rayleigh 13 equation. 

(a) Write the Rayleigh equation as a system of two first order equations. 

(b) Show that the origin is the only critical point of this system. Determine its type and 
whether it is asymptotically stable, stable, or unstable. 

(c) Let /a = 1. Choose initial conditions, and compute the corresponding solution of 
the system on an interval such as 0 < t < 20 or longer. Plot u versus t , and also plot the 
trajectory in the phase plane. Observe that the trajectory approaches a closed curve (limit 
cycle). Estimate the amplitude A and the period T of the limit cycle. 

(d) Repeat part (c) for other values of /x, such as /x = 0.2,0.5,2, and 5. In each case 
estimate the amplitude A and the period T. 

(e) Describe how the limit cycle changes as /x increases. For example, make a table of 
values and/or plot A and T as functions of /x. 

16. Consider the system of equations 

x' = ilx + y - x(x 2 + y 2 ), y' = -x + \±y - y{x 2 + y 2 ), (i) 

where /x is a parameter. Observe that this system is the same as the one in Example 1, 
except for the introduction of /x. 

(a) Show that the origin is the only critical point. 

(b) Find the linear system that approximates Eqs. (i) near the origin, and find its eigen¬ 
values. Determine the type and stability of the critical point at the origin. How does this 
classification depend on /x? 

(c) Referring to Example 1 if necessary, rewrite Eqs. (i) in polar coordinates. 

(d) Show that when /x > 0, there is a periodic solution r = v //x. By solving the system 
found in part (c), or by plotting numerically computed approximate solutions, conclude 
that this periodic solution attracts all other nonzero solutions. 

Note: As the parameter /x increases through the value zero, the previously asymptot¬ 
ically stable critical point at the origin loses its stability, and simultaneously a new 
asymptotically stable solution (the limit cycle) emerges. Thus the point /x = 0 is a 
bifurcation point; this type of bifurcation is called a Hopf 14 bifurcation. 

£*2/ 17. Consider the van der Pol system 

x! = y, y' = —x + /x(l - x 2 )y, 
where now we allow the parameter /x to be any real number. 

(a) Show that the origin is the only critical point. Determine its type, its stability property, 
and how these depend on /x. 


13 John William Strutt (1842-1919), the third Lord Rayleigh, made notable contributions in several areas 
of mathematical physics. His theory of scattering (1871) provided the first correct explanation of why 
the sky is blue, and his two volume treatise The Theory of Sound, published in 1877 and 1878, is one of the 
classics of applied mathematics. Apart from five years as Cavendish Professor of Physics at Cambridge, 
he worked primarily in his private laboratory at home. He was awarded the Nobel Prize for Physics in 
1904 for the discovery of argon. 

14 Eberhard Hopf (1902-1983) was born in Austria and educated at the University of Berlin but spent 
much of his life in the United States, mainly at Indiana University. He was one of the founders of ergodic 
theory. Hopf bifurcations are named for him in honor of his rigorous treatment of them in a 1942 paper. 
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(b) Let /x = — 1; draw a phase portrait, and conclude that there is a periodic solution that 
surrounds the origin. Observe that this periodic solution is unstable. Compare your plot 
with Figure 9.7.4. 

(c) Draw a phase portrait for a few other negative values of /x. Describe how the shape 
of the periodic solution changes with /x. 

(d) Consider small positive or negative values of /x. By drawing phase portraits, determine 
how the periodic solution changes as /x 0. Compare the behavior of the van der Pol 
system as /x increases through zero with the behavior of the system in Problem 16. 

Problems 18 and 19 extend the consideration of the Rosenzweig-MacArthur predator- 
prey model introduced in Problem 13 of Section 9.5. 

18. Consider the system 



Observe that this system differs from that in Problem 13 of Section 9.5 only in the growth 
rate for the prey. 

(a) Find all of the critical points. 

(b) Determine the type and stability of each critical point. 

(c) Draw a phase portrait in the first quadrant, and conclude that there is an asymptotically 
stable limit cycle. Thus this model predicts a stable long-term oscillation of the prey and 
predator populations. 

19. Consider the system 



where a is a positive parameter. Observe that this system includes the one in Problem 18 
above and also the one in Problem 13 in Section 9.5. 

(a) Find all of the critical points. 

(b) Consider the critical point in the interior of the first quadrant. Find the eigenvalues of 
the approximate linear system. Determine the value a 0 where this critical point changes 
from asymptotically stable to unstable. 

(c) Draw a phase portrait for a value of a slightly greater than ao. Observe that a limit 
cycle has appeared. How does the limit cycle change as a increases further? 

20. There are certain chemical reactions in which the constituent concentrations oscillate 
periodically over time. The system 


x' = 1 - (b + l)x + x 2 y/ 4, y' = bx — x 2 y/4 


is a special case of a model, known as the Brusselator, of this kind of reaction. Assume 
that b is a positive parameter, and consider solutions in the first quadrant of the xy-plane. 

(a) Show that the only critical point is (1, 4b). 

(b) Find the eigenvalues of the approximate linear system at the critical point. 

(c) Classify the critical point as to type and stability. How does the classification depend 
on bl 

(d) As b increases through a certain value bo, the critical point changes from asymptoti¬ 
cally stable to unstable. What is that value 6 0 ? 
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(e) Plot trajectories in the phase plane for values of b slightly less than and slightly greater 
than bo. Observe the limit cycle when b > b 0 ; the Brusselator has a Hopf bifurcation point 
at bo. 

(f) Plot trajectories for several values of b > bo and observe how the limit cycle deforms 
as b increases. 

21. The system 

x! = 3(x -by — |x 3 — k), y' = — \(x + 0.8y — 0.7) 

is a special case of the Fitzhugh-Nagumo 15 equations, which model the transmission of 
neural impulses along an axon. The parameter k is the external stimulus. 

(a) Show that the system has one critical point regardless of the value of k. 

(b) Find the critical point for k = 0, and show that it is an asymptotically stable spiral 
point. Repeat the analysis for k = 0.5, and show that the critical point is now an unstable 
spiral point. Draw a phase portrait for the system in each case. 

(c) Find the value ko where the critical point changes from asymptotically stable to 
unstable. Find the critical point and draw a phase portrait for the system for k = ko. 

(d) For k > k 0 the system exhibits an asymptotically stable limit cycle; the system has a 
Hopf bifurcation point at k 0 . Draw a phase portrait for k = 0.4,0.5, and 0.6; observe that 
the limit cycle is not small when k is near ko. Also plot x versus t and estimate the period 
T in each case. 

(e) As k increases further, there is a value k\ at which the critical point again becomes 
asymptotically stable and the limit cycle vanishes. Find k\. 


9.8 Chaos and Strange Attractors: The Lorenz Equations 


In principle, the methods described in this chapter for second order autonomous sys¬ 
tems can be applied to higher order systems as well. In practice, several difficulties 
arise when we try to do this. One problem is that there is simply a greater num¬ 
ber of possible cases that can occur, and the number increases with the number of 
equations in the system (and the dimension of the phase space). Another problem is 
the difficulty of graphing trajectories accurately in a phase space of more than two 
dimensions; even in three dimensions it may not be easy to construct a clear and 
understandable plot of the trajectories, and it becomes more difficult as the number 
of variables increases. Finally—and this has been widely recognized only since the 
1970s—there are different and very complex phenomena that can occur, and fre¬ 
quently do occur, in systems of third and higher order that are not present in second 
order systems. Our goal in this section is to provide a brief introduction to some of 
these phenomena by discussing one particular three-dimensional autonomous sys¬ 
tem that has been intensively studied. In some respects, the presentation here is 
similar to the treatment of the logistic difference equation in Section 2.9. 


15 Richard Fitzhugh (1922-2007) of the United States Public Health Service and Jin-Ichi Nagumo (1926- 
1999) of the University of Tokyo independently proposed a simplification of the Hodgkin-Huxley model 
of neural transmission around 1961. 
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An important problem in meteorology, and in other applications of fluid dynam¬ 
ics, concerns the motion of a layer of fluid, such as the earth’s atmosphere, that is 
warmer at the bottom than at the top; see Figure 9.8.1. If the vertical temperature 
difference AT is small, then there is a linear variation of temperature with altitude 
but no significant motion of the fluid layer. However, if AT is large enough, then the 
warmer air rises, displacing the cooler air above it, and a steady convective motion 
results. If the temperature difference increases further, then eventually the steady 
convective flow breaks up and a more complex and turbulent motion ensues. 


\ Temperature 
j difference AT 

Cooler 


Warmer 

FIGURE 9.8.1 A layer of fluid heated from below. 


While investigating this phenomenon, Edward N. Lorenz 16 was led (by a pro¬ 
cess too involved to describe here) to the nonlinear autonomous three-dimensional 
system 


dx/dt — cr(—x + y), 

dy/dt = rx—y — xz , (1) 

dz/dt = —bz +xy. 

Equations (1) are now commonly referred to as the Lorenz equations. 17 Observe that 
the second and third equations involve quadratic nonlinearities. However, except for 
being a system of three equations, superficially the Lorenz equations appear no more 
complicated than the competing species and predator-prey equations discussed in 
Sections 9.4 and 9.5. The variable x in Eqs. (1) is related to the intensity of the 
fluid motion, while the variables y and z are related to the temperature variations 
in the horizontal and vertical directions. The Lorenz equations also involve three 
parameters a, r, and 6, all of which are real and positive. The parameters a and b 
depend on the material and geometrical properties of the fluid layer. For the earth’s 
atmosphere, reasonable values of these parameters are o — 10 and b = 8/3; they 
will be assigned these values in much of what follows in this section. The parameter r, 
on the other hand, is proportional to the temperature difference A T, and our purpose 
is to investigate how the nature of the solutions of Eqs. (1) changes with r. 


16 Edward N. Lorenz (1917-2008), an American meteorologist, received his Ph.D. from the Massachusetts 
Institute of Technology in 1948 and was associated with that institution throughout his scientific career. 
His first studies of the system (1) appeared in a famous 1963 paper (cited in the references) dealing with 
the stability of fluid flows in the atmosphere. 

11 A very thorough treatment of the Lorenz equations appears in the book by Sparrow listed in the 
references at the end of this chapter. 
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Before proceeding further, we note that for an autonomous system of three first 
order equations 


dx/dt = F(x,y,z ), dy/dt = G(x,y,z), dz/dt = H(x,y,z ), 

the Jacobian matrix J is defined by 


/ F x 


F 7 \ 


G x G y G z 

N #* #z / 

Thus, for the Lorenz equations (1), the Jacobian matrix is 


J = 


/ — (7 

r - z 

\ y 


a 

-1 

x 


0 > 

x 

b ) 


( 2 ) 


( 3 ) 


( 4 ) 


The first step in analyzing the Lorenz equations is to locate the critical points by 
solving the algebraic system 

ax — cry = 0, 

rx — y — xz — 0, (5) 

—bz +xy = 0. 


From the first equation we have y = x. Then, eliminating y from the second and 
third equations, we obtain 

x(r - 1 - z) = 0, (6) 

-bz+x 2 = 0. (7) 

One way to satisfy Eq. (6) is to choose x = 0. Then it follows that y = 0 and, 
from Eq. (7), z = 0. Alternatively, we can satisfy Eq. (6) by choosing z — r — 1. Then 
Eq. (7) requires that x = ± +Jb(r — 1) and then y — ±^Jb(r — 1) also. Observe that 
these expressions for x and y are real only when r > 1. Thus (0,0,0), which we will 
denote by Pi, is a critical point for all values of r, and it is the only critical point 
for r < 1. However, when r > 1, there are also two other critical points, namely, 
(y/b(r — 1), *Jb(r — 1), r — 1) and (—*Jb(r — 1), —y/b(r — 1), r — 1). We will denote 
the latter two points by P 2 and P3, respectively. Note that all three critical points 
coincide when r = 1. As r increases through the value 1, the critical point P\ at the 
origin bifurcates, and the critical points P 2 and P 3 come into existence. 

Next we will determine the local behavior of solutions in the neighborhood of 
each critical point. Although much of the following analysis can be carried out for 
arbitrary values of a and b , we will simplify our work by using the values a = 10 and 
b = 8/3. Near the origin (the critical point Pi), the approximating linear system is 




/- 

-10 

10 

0 \ 


y 

= 


r 

-1 

0 

y 

W 



0 

0 

-8/3) 

w 
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The eigenvalues 18 are determined from the equation 


—10 — A 10 0 

r — 1 — A 0 

0 0 -8/3 - A 


-(8/3 + A)[A 2 + 11A - 10(r - 1)] = 0. (9) 


Therefore, 


Ai = — 


8 

3’ 


A 2 


-11 - V81 + 40r 
2 


A 3 


-11 + V81 + 40r 
2 


( 10 ) 


Note that all three eigenvalues are negative for r < l; for example, when r = 1/2, 
the eigenvalues are = -8/3, X 2 = -10.52494, X 2 = -0.47506. Hence the origin is 
asymptotically stable for this range of r both for the linear approximation (8) and 
for the original system (1). However, A .3 changes sign when r = 1 and is positive for 
r > 1. The value r — 1 corresponds to the initiation of convective flow in the physical 
problem described earlier. The origin is unstable for r > i; all solutions starting near 
the origin tend to grow, except for those lying precisely in the plane determined 
by the eigenvectors associated with and X 2 [or, for the nonlinear system ( 1 ), in a 

certain surface tangent to this plan e at the ori gin]._ 

The second critical point is P 2 (j%(r - l)/3, ^8(r - l)/3, r — 1) for r > 1. To con¬ 
sider the neighborhood of this critical point, let u , v, and w be the perturbations from 
the critical point in the x-,y-, and z-directions, respectively. The approximating linear 
system is 


^ u ^ 

/ 

-10 

10 

0 ^ 

( u ^ 

V 

= 

l 

-1 -y/8(r - l)/3 

V 

w 


l^8(r - l)/3 

V8(r - l)/3 

-8/3 / 

\ w ) 


The eigenvalues of the coefficient matrix of Eq. (11) are determined from the 
equation 

3A 3 + 41A 2 + 8(r + 10)A + 160(r - 1) = 0, (12) 


which is obtained by straightforward algebraic steps that are omitted here. The 
solutions of Eq. (12) depend on r in the following way: 

Fori < r < ri = 1.3456 there are three negative real eigenvalues. 

Forri < r < r 2 = 24.737 there are one negative real eigenvalue and two complex 
eigenvalues with negative real part. 

For r 2 < r there are one negative real eigenvalue and two complex eigenvalues 
with positive real part. 

The same results are obtained for the critical point P 2 . Thus there are several 
different situations. 

For 0 < r < 1 the only critical point is P\ and it is asymptotically stable. All 
solutions approach this point (the origin) as t oo. 


18 Since r appears as a parameter in the Lorenz equations, we will use X to denote the eigenvalues. 
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For 1 < r < r\ the critical points P 2 and P3 are asymptotically stable and P\ is 
unstable. All nearby solutions approach one or the other of the points P2 and P3 
exponentially. 

For r\ < r < the critical points P2 and P3 are asymptotically stable and Pi is 
unstable. All nearby solutions approach one or the other of the points P 2 and P 3 ; 
most of them spiral inward to the critical point. 

For V 2 < r all three critical points are unstable. Most solutions near P2 or P3 spiral 
away from the critical point. 

However, this is by no means the end of the story. Let us consider solutions for r 
somewhat greater than r 2 . In this case Pi has one positive eigenvalue, and each of 
P2 and P3 has a pair of complex eigenvalues with positive real part. A trajectory can 
approach any one of the critical points only on certain highly restricted paths. The 
slightest deviation from these paths causes the trajectory to depart from the critical 
point. Since none of the critical points is stable, one might expect that most trajectories 
would approach infinity for large t. However, it can be shown that all solutions remain 
bounded as t -> 00 ; see Problem 5. In fact, it can be shown that all solutions ultimately 
approach a certain limiting set of points that has zero volume. Indeed, this is true not 
only for r > r2 but for all positive values of r. 

A plot of computed values of x versus t for a typical solution with r > r2 is shown 
in Figure 9.8.2. Note that the solution oscillates back and forth between positive and 
negative values in a rather erratic manner. Indeed, the graph of x versus t resem¬ 
bles a random vibration, although the Lorenz equations are entirely deterministic 
and the solution is completely determined by the initial conditions. Nevertheless, 
the solution also exhibits a certain regularity in that the frequency and amplitude 
of the oscillations are essentially constant in time. 



FIGURE 9.8.2 A plot of x versus t for the Lorenz equations (1) with r = 28; 
the initial point is (5,5,5). 

The solutions of the Lorenz equations are also extremely sensitive to perturbations 
in the initial conditions. Figure 9.8.3 shows the graphs of computed values of x versus 
t for the two solutions whose initial points are (5,5,5) and (5.01,5,5). The dashed 
graph is the same as the one in Figure 9.8.2, while the solid graph starts at a nearby 
point. The two solutions remain close until t is near 10, after which they are quite 
different and, indeed, seem to have no relation to each other. It was this property 
that particularly attracted the attention of Lorenz in his original study of these 
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FIGURE 9.8.3 Plots of x versus t for two initially nearby solutions of Lorenz equations with 
r = 28; the initial point is (5,5,5) for the dashed curve and is (5.01,5,5) for the solid curve. 


equations, and it caused him to conclude that accurate detailed long-range weather 
predictions are probably not possible. 

The attracting set in this case, although of zero volume, has a rather complicated 
structure and is called a strange attractor. The term chaotic has come into general 
use to describe solutions such as those shown in Figures 9.8.2 and 9.8.3. 

To determine how and when the strange attractor is created, it is illuminating to 
investigate solutions for smaller values of r. For r = 21, solutions starting at three dif¬ 
ferent initial points are shown in Figure 9.8.4. For the initial point (3,8,0) the solution 
begins to converge to the point P 3 almost at once; see Figure 9.8.4a. For the second 
initial point (5,5,5) there is a fairly short interval of transient behavior, after which 
the solution converges to P 2 ; see Figure 9.8.4Z). However, as shown in Figure 9.8.4c, 
for the third initial point (5,5,10) there is a much longer interval of transient chaotic 
behavior before the solution eventually converges to P 2 . As r increases, the duration 
of the chaotic transient behavior also increases. When r = r 3 = 24.06, the chaotic 
transients appear to continue indefinitely, and the strange attractor comes into being. 

We can also show the trajectories of the Lorenz equations in the three- 
dimensional phase space, or at least projections of them in various planes. Figures 
9.8.5 and 9.8.6 show projections in the xy- and xz-planes, respectively, of the tra¬ 
jectory starting at (5,5,5). Observe that the graphs in these figures appear to cross 
over themselves repeatedly, but this cannot be true for the actual trajectories in 
three-dimensional space because of the general uniqueness theorem. The apparent 
crossings are due wholly to the two-dimensional character of the figures. 

The sensitivity of solutions to perturbations of the initial data also has impli¬ 
cations for numerical computations, such as those reported here. Different step 
sizes, different numerical algorithms, and even the execution of the same algorithm 
on different machines will introduce small differences in the computed solution, 
which eventually lead to large deviations. For example, the exact sequence of pos¬ 
itive and negative loops in the calculated solution depends strongly on the precise 
numerical algorithm and its implementation, as well as on the initial conditions. 
However, the general appearance of the solution and the structure of the attracting 
set are independent of all these factors. 
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FIGURE 9.8.4 Plots of x versus t for three solutions of Lorenz equations with r = 21. 
(a) Initial point is (3,8,0). ( b ) Initial point is (5,5,5). (c) Initial point is (5,5,10). 




FIGURE 9.8.5 Projections of a trajectory of the Lorenz equations 
(with r = 28) in the xy-plane. 
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FIGURE 9.8.6 Projections of a trajectory of the Lorenz equations 
(with r = 28) in the xz-plane. 


Solutions of the Lorenz equations for other parameter ranges exhibit other 
interesting types of behavior. For example, for certain values of r greater than 
r 2 , intermittent bursts of chaotic behavior separate long intervals of apparently 
steady periodic oscillation. For other ranges of r, solutions show the period-doubling 
property that we saw in Section 2.9 for the logistic difference equation. Some of these 
features are taken up in the problems. 

Since about 1975 the Lorenz equations and other higher-dimensional autonomous 
systems have been studied intensively, and this is one of the most active areas of cur¬ 
rent mathematical research. Chaotic behavior of solutions appears to be much more 
common than was suspected at first, and many questions remain unanswered. Some 
of these are mathematical in nature, while others relate to the physical applications 
or interpretations of solutions. 


PROBLEMS Problems 1 through 3 ask you to fill in some of the details of the analysis of the Lorenz equations 

in this section. 

1. (a) Show that the eigenvalues of the linear system (8), valid near the origin, are given by 
Eq. (10). 

(b) Determine the corresponding eigenvectors. 

(c) Determine the eigenvalues and eigenvectors of the system (8) in the case where r = 28. 

2. (a) Show that the linear approximation valid near the critical point P 2 is given by Eq. (11). 

(b) Show that the eigenvalues of the system (11) satisfy Eq. (12). 

(c) For r = 28, solve Eq. (12) and thereby determine the eigenvalues of the system (11). 

3. (a) By solving Eq. (12) numerically, show that the real part of the complex roots changes 
sign when r = 24.737. 

(b) Show that a cubic polynomial x 3 4 + * 1 Ax 2 + Bx + C has one real zero and two pure 
imaginary zeros only if AB = C. 

(c) By applying the result of part (b) to Eq. (12), show that the real part of the complex 
roots changes sign when r = 470/19. 

4. Use the Liapunov function V (x,y, z) = x 2 + cry 2 + vz 2 to show that the origin is a globally 
asymptotically stable critical point for the Lorenz equations (1) if r < 1. 
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5. Consider the ellipsoid 

V(x,y,z) = rx 2 + ay 2 + a(z - 2 r) 2 = c > 0. 

(a) Calculate dV/dt along trajectories of the Lorenz equations (1). 

(b) Determine a sufficient condition on c so that every trajectory crossing V(x,y,z) = c 
is directed inward. 

(c) Evaluate the condition found in part (b) for the case o — 10, b = 8/3, r = 28. 

Problems 6 through 10 suggest some further investigations of the Lorenz equations. 

6. For r = 28, plot x versus t for the cases shown in Figures 9.8.2 and 9.8.3. Do your graphs 
agree with those shown in the figures? Recall the discussion of numerical computation in 
the text. 

4fl 7. For r = 28, plot the projections in the xy- and xz-planes, respectively, of the trajectory 
starting at the point (5,5,5). Do the graphs agree with those in Figures 9.8.5 and 9.8.6? 

8. (a) For r = 21, plot x versus t for the solutions starting at the initial points (3,8,0), (5,5,5), 
and (5,5,10). Use a ^-interval of at least 0 < t < 30. Compare your graphs with those in 
Figure 9.8.4. 

(b) Repeat the calculation in part (a) for r = 22, r = 23, and r = 24. Increase the t interval 
as necessary so that you can determine when each solution begins to converge to one of 
the critical points. Record the approximate duration of the chaotic transient in each case. 
Describe how this quantity depends on the value of r. 

(c) Repeat the calculations in parts (a) and (b) for values of r slightly greater than 24. 
Try to estimate the value of r for which the duration of the chaotic transient approaches 
infinity. 

9. For certain r intervals, or windows, the Lorenz equations exhibit a period-doubling prop¬ 
erty similar to that of the logistic difference equation discussed in Section 2.9. Careful 
calculations may reveal this phenomenon. 

(a) One period-doubling window contains the value r = 100. Let r = 100 and plot the 
trajectory starting at (5,5,5) or some other initial point of your choice. Does the solution 
appear to be periodic? What is the period? 

(b) Repeat the calculation in part (a) for slightly smaller values of r. When r = 99.98, you 
may be able to observe that the period of the solution doubles. Try to observe this result 
by performing calculations with nearby values of r. 

(c) As r decreases further, the period of the solution doubles repeatedly. The next period 
doubling occurs at about r = 99.629. Try to observe this by plotting trajectories for nearby 
values of r. 

10- Now consider values of r slightly larger than those in Problem 9. 

(a) Plot trajectories of the Lorenz equations for values of r between 100 and 100.78. You 
should observe a steady periodic solution for this range of r values. 

(b) Plot trajectories for values of r between 100.78 and 100.8. Determine as best you can 
how and when the periodic trajectory breaks up. 

The Rossler 19 System. The system 

x' = —y - z, y'=x + ay, z' = b + z(x-c), (i) 


19 Otto E. Rossler (1940- ), a German medical doctor and biochemist, was a student and later became 

a faculty member at the University of Tubingen. The equations named for him first appeared in a paper 
he published in 1976. 
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where a , b , and c are positive parameters, is known as the Rossler system. 20 It is a relatively 
simple system, consisting of two linear equations and a third equation with a single quadratic 
nonlinearity. In Problems 11 through 15, we ask you to carry out some numerical investigations 
of this system, with the goal of exploring its period-doubling property. To simplify matters, set 
a = 0.25, set b = 0.5, and let c > 0 remain arbitrary. 

4fl ii- (a) Show that there are no critical points when c < V(I5, there is one critical point for 
c = V(I5, and there are two critical points when c > V05. 

(b) Find the critical point(s) and determine the eigenvalues of the associated Jacobian 
matrix when c = y/o3 and when c — 1. 


(c) How do you think trajectories of the system will behave for c = 1? Plot the trajectory 
starting at the origin. Does it behave the way that you expected? 

(d) Choose one or two other initial points, and plot the corresponding trajectories. Do 
these plots agree with your expectations? 

12. (a) Let c = 1.3. Find the critical points and the corresponding eigenvalues. What 
conclusions, if any, can you draw from this information? 

(b) Plot the trajectory starting at the origin. What is the limiting behavior of this trajec¬ 
tory? To see the limiting behavior clearly, you may wish to choose a t-interval for your 
plot so that the initial transients are eliminated. 

(c) Choose one or two other initial points, and plot the corresponding trajectories. Are 
the limiting behavior(s) the same as in part (b)? 

(d) Observe that there is a limit cycle whose basin of attraction is fairly large (although 
not all of xyz-space). Draw a plot of x,y, or z versus t , and estimate the period 7\ of motion 
around the limit cycle. 


4fl 13 - 


4fl 14 - 


The limit cycle found in Problem 12 comes into existence as a result of a Hopf bifurcation 
at a value c\ of c between 1 and 1.3. Determine, or at least estimate more precisely, the 
value of Ci. There are several ways in which you might do this. 

(a) Draw plots of trajectories for different values of c. 

(b) Calculate eigenvalues at critical points for different values of c. 

(c) Use the result of Problem 3(b) above. 

(a) Let c = 3. Find the critical points and the corresponding eigenvalues. 

(b) Plot the trajectory starting at the point (1,0,—2). Observe that the limit cycle now 
consists of two loops before it closes; it is often called a 2-cycle. 

(c) Plot x, y, or z versus t, and show that the period T 2 of motion on the 2-cycle is very 
nearly double the period T\ of the simple limit cycle in Problem 12. There has been a 
period-doubling bifurcation of cycles for a certain value of c between 1.3 and 3. 


15. (a) Let c = 3.8. Find the critical points and the corresponding eigenvalues. 

(b) Plot the trajectory starting at the point (1,0, —2). Observe that the limit cycle is now a 
4-cycle. Find the period r 4 of motion. Another period-doubling bifurcation has occurred 
for c between 3 and 3.8. 


(c) For c = 3.85, show that the limit cycle is an 8-cycle. Verify that its period is very close 
to eight times the period of the simple limit cycle in Problem 12. 

Note: As c increases further, there is an accelerating cascade of period-doubling bifurca¬ 
tions. The bifurcation values of c converge to a limit, which marks the onset of chaos. 


20 See the book by Strogatz for a more extensive discussion and further references. 
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Answers to 
Problems 


CHAPTER 1 Section 1.1, page 7 


y 3/2 as t oo 

2 . y diverges from 3/2 as t ^ oo 

y diverges from —3/2 as t ^ oo 

4 . y —1/2 as t oo 

y diverges from — 1/2 as t oo 

6 , y diverges from — 2 as t oo 

x. 

II 

U) 

1 

8 . y' = 2 — 3y 

y' = y- 2 

10 . y' = 3y-l 


y = 0 andy = 4 are equilibrium solutions; y —> 4 if initial value is positive; y diverges from 
0 if initial value is negative. 

12. y = 0 and y = 5 are equilibrium solutions;}; diverges from 5 if initial value is greater than 
5; y —^ 0 if initial value is less than 5. 

13. y = 0 is equilibrium solution; —> 0 if initial value is negative; y diverges from 0 if initial 
value is positive. 

y = 0 and y = 2 are equilibrium solutions; y diverges from 0 if initial value is negative; 
y ^ 2 if initial value is between 0 and 2;y diverges from 2 if initial value is greater than 2. 
15. (j) 16. (c) 17. (g) 18. (b) 19. (h) 20 (e) 

21. (a) dq/dt = 300(10 -2 — <?10 -6 ); q in g, t in h (b) q -*■ 10 4 g; no 

22. dV/dt = -kV 2 ' 3 for some k > 0. 

23. du/dt = — 0.05(w — 70); u in °F, t in min 

24. (a) dq/dt = 500 — 0.4g; q in mg, t in h (b) q -*■ 1250 mg 

25. (a) mv' = mg — kv 2 (b) v —► y/mg/k (c) k = 2/49 

26. y is asymptotic to t — 3 as t -> oo 

27. y 0 as t oo 

28. y oo, 0, or —oo depending on the initial value of y 

29. y oo or —oo depending on the initial value of y 

30. y oo or —oo or y oscillates depending on the initial value of y 

31. y ^ —oo or is asymptotic to *j2t — 1 depending on the initial value of y 

32. y -> 0 and then fails to exist after some tf > 0 

33. y -> oo or — oo depending on the initial value of y 
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Answers to Problems 


CHAPTER 2 


Section 1.2, page 15 

1. (a) y = 5 + (y 0 — (b) y = (5/2) + [y 0 - (5/2)]e~ 2t (c) y = 5 + (y 0 - 5)e~ 2t 

Equilibrium solution is y = 5 in (a) and (c),y = 5/2 in (b); solution approaches equilibrium 
faster in (b) and (c) than in (a). 

2. (a) y = 5 + (y 0 - 5)e { (b) y = (5/2) + [y 0 - (5/2)]e 2r (c) y = 5 + (y 0 - 5)e 2t 

Equilibrium solution is y = 5 in (a) and (c), y = 5/2 in (b); solution diverges from 
equilibrium faster in (b) and (c) than in (a). 

3. (a) y = ce~ at + (b/a) 

(c) (i) Equilibrium is lower and is approached more rapidly, (ii) Equilibrium is higher, 
(iii) Equilibrium remains the same and is approached more rapidly. 

4. (a) y e = b/a (b) Y' = aY 

5. (a) y\(t) = ce at (b) y = ce at + (b/a) 

6. y = ce~ at + (b/a) 

7. (a) T = 2 In 18 = 5.78 months (b) T = 21n[900/(900 -p 0 )] months 
(c) po = 900(1 - <r 6 ) = 897.8 

8. (a) r = (In 2)/30 day -1 (b) r = (In 2 )/N day -1 

9. (a) 7 = 5 In 50 = 19.56 s (b) 718.34 m 

10. (a) dv/dt = 9.8, u(0) = 0 (b) T = ^300/4.9 = 7.82 s (c) v = 76.68 m/s 

(b) v = 49tanh(//5) m/s (e) x = 245 lncosh(t/5) m (f) T = 9.48 s 

12. (a) r = 0.02828 day- 1 (b) Q(t) = 100c-° 02828? (c) T = 24.5 d 

14. 1620 ln(4/3)/ln2 = 672.4 yr 

15. (a) u = T + (uo — T)e~ kt (b) kz = In 2 

16. 6.69 h 

17. (a) Q(t) = CV( 1 - e-V™) (b) Q(t) CV = Q L 

(c) Q(t) = CV exp[-(f - h)/RC] 

18. (a) Q = 3(1 - 10- 4 5 6 7 G), Q( 0) = 0 

(b) Q(t ) = 10 4 (1 - t'- 3,/K|4 ), t in h; after 1 year O = 9277.77 g 

(c) Q' = -3g/10 4 , g(0) = 9277.77 

(d) Q(0 = 9277.77e _3,/1 ° 4 , / in h; after 1 year 2 = 670.07 g (e) T = 2.60 yr 

19. (a) q' = -4/300, 4(0) = 5000 g (b) q(t) = 5000e-' /30 ° (c) no 

(d) T = 300 In(25/6) = 428.13 min = 7.136 h (e) r = 250 ln(25/6) = 356.78 gal/min 


Section 1.3, page 24 

Second order, linear 

3. Fourth order, linear 
5. Second order, nonlinear 

15. r = -2 

17. r = 2,-3 
19. r = -1,-2 
21. Second order, linear 
23. Fourth order, linear 


2. Second order, nonlinear 

4. First order, nonlinear 
6. Third order, linear 

16. r = ±1 

18. r = 0,1,2 

20. r = 1,4 

22. Second order, nonlinear 
24. Second order, nonlinear 


Section 2.1, page 39 


1. (c) y = ce~ 3t + (t/ 3) — (1/9) + e~ 2t \ y is asymptotic to t/3 — 1/9 as t -> oo 

2. (c) y = ce 2t + t 3 e 2 73; y oo as t oo 

3. (c) y = ce~ f + 1 + t 2 e _ 72 ; y 1 as t -> oo 

4. (c) y = (c/t) + (3 cos2t)/4t + (3 sin2t)/2; y is asymptotic to (3 sin2t)/2 as t 

5. (c) y = ce 2t — y oo or — oo as t oo 

6. (c) y = (c — t cos t + sin t)/t 2 \ y -> 0 as t oo 

7. (c) y = t 2 e _? + ; y ^ 0 as t ^ oo 
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8. (c) y = (arctarU + c)/( 1 + t 2 ) 2 ; y -> 0 as t -> oo 

9. (c) y = ce ~ tf2 + 3t — 6; y is asymptotic to 3t — 6 as t -> oo 

10. (c) y = —+ c£; y -> oo, 0, or —oo as t -> oo 

11. (c) y = ce 1 + sin 2 t — 2 cos 21 ; y is asymptotic to sin 2 t — 2 cos 2 t as t -> oo 

12. (c) y = ce ~ t/2 + 3t 2 — 12 1 + 24; y is asymptotic to 3 1 2 — 12t + 24 as t -> oo 

13. y = 3e* + 2 (t - l)e 2t 

14. y = (t 2 — l)e~ 2t /2 

15. y = (3 t A - 41 3 + 6 1 2 + l)/12t 2 

16. y = (sin t )/£ 2 

17. y = (f + 2)e 2r 

18. y = t _2 [(7T 2 /4) - 1 — t cos t + sin t ] 

19. y = —(1 + t)e~ f /t 4 , t / 0 

20. y = (f-l + 2e-0A, t ^ 0 

21. (b) y = — | cos t + | sin t + (a + |)^ /2 ; ao = — | (c) y oscillates for a = ao 

22. (b) y = -3e r/3 + (a + 3)^ /2 ; a 0 = -3 (c) y -oo for a = a 0 

23. (b) y = [2 + a( 37 T + 4)e 2 7 3 - 2e- nt / 2 ]/(3jT + 4); a 0 = -2/(3 n + 4) 

(c) y —» 0 for a = a 0 

24. (b) y = te~ { + (ea — l)e - 7 1 \ a 0 = 1/e (c) y 0 as t -> 0 for a = a 0 

25. (b) y = —(cos t)A 2 + 7 i 2 a/ 4 t 2 \ ao = 4/7T 2 (c) y ^ | as t ^ 0 for a = a 0 

26. (b) y = (^ — e + a sin 1)/ sin t; a 0 = (e — 1)/ sin 1 (c) y 1 for a = ao 

27. (f,y) = (1.364312,0.820082) 

28. y 0 = -1.642876 

29. (b) y = 12 + |r cos2t + ^ sin2t — ^ oscillates about 12 as t -> oo 

(c) r = 10.065778 

30. y 0 = -5/2 

31. y 0 = —16/3; y —► —oo as t ^ oo for y 0 = —16/3 

39. See Problem 2. 

40. See Problem 4. 

41. See Problem 6. 

42. See Problem 12. 

Section 2.2, page 48 

1. 3y 2 — 2x 3 = c; y ^ 0 

2. 3y 2 - 2 In |1 + x 3 | = c; x^-l,y^0 

3. y _1 + cosx = c if y ^ 0; also y = 0; everywhere 

4. 3y+ y 2 -x 3 +x = c; y ^ -3/2 

5. 2 tan 2y — 2x — sin 2x = c if cos 2y ^ 0; also y = ±(2 n + 1)7t/4 for any integer n; 
everywhere 

6. y = sin[ln |x| + c] if x ^ 0 and |y | < 1; also y = ±1 

7. y 2 —x 2 + 2(e y — e~ x ) = c; y + e y ^ 0 

8. 3y + y 3 — x 3 = c; everywhere 

9. (a) y = l/(x 2 — x — 6) (c) —2 < x < 3 

10. (a) y = -V2x - 2x 2 + 4 (c) -1 < x < 2 

(a) y = [2(1 — x)e x — 1] 1/2 (c) —1.68 < x < 0.77 approximately 

12. (a) r = 2/(1 - 21n0) (c) 0 < 6 < «Je 

13. (a) y = —[21n(l +x 2 ) +4] 1/2 (c) —oo < x < oo 

14. (a) y = [3 - 2VT+3?]” 1/2 (c) |x| < 1V5 

15. (a) y = + iV4x 2 -15 (c) x > \-J\5 

16. (a) y = -,/(x 2 + l)/2 (c) — OO < X < OO 

17. (a) y = 5/2- y/x 3 - e x + 13/4 (c) -1.4445 < x < 4.6297 approximately 
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18. (a) y = — | + \\/65 - 8e x - 8e~ x (c) |x| < 2.0794 approximately 

19. (a) y = [tt — arcsin (3cos 2 x)]/3 (c) |x - tt/2\ < 0.6155 

r 1 1/3 

20. (a) y = | (arcsin x) 2 + 1 (c) —1 < x < 1 

21. y 3 — 3y 2 — x — x 3 + 2 = 0, |x| < 1 

22. y 3 — 4y - X 3 = -1, |x 3 — 11 < 16/3 V3 or -1.28 < x < 1.60 

23. y = -l/(x 2 /2 + 2x — 1); x = —2 

24. y = —3/2 + y/2x — e x + 13/4; x = In 2 

25. y = —3/2 + ^sin2x + 1 /4; x = 7i/4 26. y = tan(x 2 + 2x); x = —1 

27. (a) y -> 4 if y 0 > 0; y = 0 if y 0 = 0; y -> -oo if y 0 < 0 (b) T = 3.29527 

28. (a) y -* 4 as t -> oo (b) 7 = 2.84367 (c) 3.6622 < y 0 < 4.4042 

c ad — be , , 

29. x = -y H--— In \ay + 6| + A:; a ^ 0, ay + b ^ 0 

a a 2 

30. (e) |y + 2x| 3 |y - 2x| = c 

31. (b) arctan (y/x) — In |x| = c 

32. (b) x 2 + y 2 — cx 3 = 0 33. (b) |y — x| = c\y + 3x| 5 ; also y = x 

34. (b) |y + x| |y + 4x| 2 = c 

35. (b) 2x/(x + y) + In |x + y | = c; also y = — x 

36. (b) x/(x + y) + In |x| = c; also y = — x 

37. (b) |x| 3 |x 2 - 5y 2 | = c 

38. (b) c|x| 3 = |y 2 - x 2 | 

Section 2.3, page 60 

1. t = 100 In 100min = 460.5 min 2. Q(t ) = 120y[l — exp(—1/60)]; 120y 

3. Q = 50e~ 02 (l - e~ 0 - 2 ) lb = 7.42 lb 

4. Q(t) = 200 + f - [100(200) 2 /(200 + t) 2 ] lb, t < 300; c = 121/125 lb/gal; 
lim c = 1 lb/gal 

t-> oo 

5. (a) Q(t) = ^e“ ,/5 ° + 25 - ^ cos r + ^ sin f 

(c) level = 25; amplitude = 2572501/5002 = 0.24995 

6. (c) 130.41 s 

7. (a) (In 2)/r yr (b) 9.90 yr (c) 8.66% 

8. (a) k(e n - 1 )/r (b) k = $3930 (c) 9.77% 

9. k = $3086.64/yr; $1259.92 

10. (a) $209,641.74 (20 years); $250,410.33 (30 years) 

(b) $150,358.26 (20 years); $289,589.67 (30 years) 

11. (a) $1788.77 (20 years); $1497.54 (30 years) 

(b) $179,303.83 (20 years); $289,115.13 (30 years) 

12. (a) t = 146.54 months (b) $246,758.02 

13. (a) 0.00012097 yr” 1 (b) Q 0 exp(-0.00012097t), t in yr (c) 13,305 yr 

14. (a) r = 2.9632; no (b) r = 10 In 2 = 6.9315 (c) r = 6.3805 

15. (b) y c = 0.83 

16. t = In y/ In min = 6.07 min 

17. (a) u(t) = 2000/(1 + 0.048r) 1/3 (c) r = 750.77 s 

18. (a) u(t ) = ce~ kt + To + kT\(k cos ojt + co sin cot)/(k 2 + co 2 ) 

(b) R = 9.11°F ; r = 3 .51 h 

(c) R = kT |/VA' 2 + or: x = (1 /co) arctan (<o/k) 

19. (a) c = k + (P/r) + [co — k — ( P/r)]e ~ rl/v ; lim c = k + ( P/r ) 

1—► OO 

(b) T = (V In 2)/r; T = (V In 10)/r 

(c) Superior, T = 431 yr; Michigan, T = 71.4 yr; Erie, T = 6.05 yr; Ontario, T = 17.6 yr 

20. (a) 50.408 m (b) 5.248 s 

21. (a) 45.783 m (b) 5.129 s 
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22. (a) 48.562 m (b) 5.194 s 

23. (a) 176.7 ft/s (b) 1074.5 ft (c) 15 ft/s 

24. (a) dv/dx = —fiv (b) /x = (66/25) In 10 mi 


(d) 256.6 s 
r 1 = 6.0788 mi- 1 


(c) r = 900/(11 In 10) s = 35.533 s 



26. (a) v = -(mg/k) + [u 0 + (mg/k)] exp (-kt/m) (b) v = v 0 - gt; yes 

(c) v = 0 for t > 0 

27. (a) v L = 2a 2 g(p - p')/9p (b) e = 4jra 3 g(p - p')/3E 

28. (a) 11.58 m/s (b) 13.45 m (c) k > 0.2394 kg/s 

29. (a) i; = Rj2g/(R + x) (b) 50.6 h 

30. (b) x = ut cos A, y = —gt 1 12 + ut sin A + h 

(d) — 1 6L 2 /(u 2 cos 2 A) + L tan A + 3 > H 

(e) 0.63 rad <A< 0.96 rad (f) u = 106.89 ft/s, A = 0.7954 rad 

31. (a) v = (ucosA)e~ rt , w = —g/r + (usmA + g/r)e~ rt 

(b) x = ucosA(l — e~ rt )/r, y = —gt/r + (u sin A + g/r)(l — e~ n )/r + h 
(d) u = 145.3 ft/s, A = 0.644 rad 

32. (d) k = 2.193 

Section 2.4, page 76 

1. 0 < t < 3 2. 0 < t < 4 

3. jt/ 2 < t < 37t/ 2 4. —oo < t < —2 

5. — 2 < t <2 6. 1 < t < 7T 

7. 2t + 5y > 0 or 2t + 5y < 0 8. t 2 + y 2 < 1 

9. 1 - t 2 + y 2 > 0 or 1 - t 2 + y 2 < 0, t ^ 0, y ^ 0 

10. Everywhere 

11. y # 0, y # 3 

12. t ^ nn for n — 0, ±1,±2,...; y ^ — 1 13. y = ±^Jyl~-4/ 2 if y 0 7^ 0; Id < |yo|/2 

14. y = [(l/y 0 ) - * 2 ] -1 if yo 7^ 0; y = 0 if y 0 = 0; 

interval is |t| < 1/^/yo if yo > 0; — 1 oo < t < oo if yo < 0 



interval is —\/2y\ < t < oo if y 0 7 ^ 0; —00 < t < 00 if y 0 = 0 

16. y = ±/|ln(l + f 3 )+y§; -[1 - expC-Syg ^)] 1 / 3 < f < oo 

17. y -> 3 if y 0 > 0; y = 0 if y 0 = 0; y -> -oo if y 0 < 0 

18. y -> -oo if y 0 < 0; y -> 0 if y 0 > 0 

19. y -> 0 if y 0 < 9; y -> oo if y 0 > 9 

20. y -> — oo if yo < y c ^ —0.019; otherwise y is asymptotic to *Jt — 1 

21 (a) No (b) Yes; set to = l/ 2 inEq. (19) in text. (c) |y| < (4/3) 3/2 = 1.5396 
22. (a) yi(t) is a solution for t > 2 ; y 2 (t) is a solution for all t 

(b) f y is not continuous at ( 2 , — 1 ) 



28. y = ±[5f/(2 + 5ct 5 )] 1/2 29. y = r/(k + cre~ n ) 

30. y = ±[6/(or + c^- 2e 0] 1/2 


29. y = r/(A; + ere rt ) 



■ nt 1 | 1/2 

2/ /x(s)efa + c ,where /x(t) = exp(2rsint + 277) 


32. y = \ (1 - e 2t ) for 0 < t < 1; y = | (e 2 - l)e 2r for t > 1 

33. y = e~ 2t for 0 < t < 1; y = e _(?+1) for t > 1 
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Section 2.5, page 88 

1. y = 0 is unstable 

2. y = —a/b is asymptotically stable, y = 0 is unstable 

3. y = 1 is asymptotically stable, y = 0 and y = 2 are unstable 

4. y = 0 is unstable 

5. y = 0 is asymptotically stable 

6. y = 0 is asymptotically stable 

7. (c) y = ly 0 + (1 - y 0 )kt]/[ 1 + (1 - y 0 )kt] 

8. y = 1 is semistable 

9. y = — 1 is asymptotically stable, y = 0 is semistable, y = 1 is unstable 
y = — 1 and y = 1 are asymptotically stable, y = 0 is unstable 

11. y = 0 is asymptotically stable, y = b 2 /a 2 is unstable 

12. y = 2 is asymptotically stable, y = 0 is semistable, y = — 2 is unstable 

13. y = 0 and y = 1 are semistable 

15. (a) r = (1/r) In 4; 55.452 yr (b) 7 = (1/r) ln[0(l - a)/(l - fla]; 175.78 yr 

16. (a) y = 0 is unstable, y = K is asymptotically stable 

(b) Concave up for 0 < y < K/e, concave down for K/e < y < K 

17. (a) y = Kexp{[\n(y 0 /K)]e- rt ] (b) y(2) = 0J153K = 57.6 x 10 6 kg 

(c) r = 2.215 yr 

18. (b) (h/a)y/k/a7t; yes (c) k/a < na 2 

19. (b) k 2 /2g(cta) 2 

20. (c) Y — Ey 2 = KE[ 1 — (E/r)] (d) Y m = Kr/4 for E = r/2 

21. (a) y U2 = K[ 1 V /1 - (4/z/r/<t 1/2 

22. (a) y = 0 is unstable, y = 1 is asymptotically stable 
(b) y = y 0 /[yo + (1 - yo)e~ at ] 

23. (a) y = y 0 e _/f ' (b) x = x 0 exp[-ay 0 (l - e~ p, )/p\ (c) x 0 exp(-ay 0 /^) 

24. (b) z = l/[v + (1 - v)e fu \ (c) 0.0927 

25. (a,b) a = 0: y = 0 is semistable. 

a > 0: y = Ja is asymptotically stable and y = — ^[a is unstable. 

26. (a) a < 0: y = 0 is asymptotically stable. 

a > 0: y = 0 is unstable; y = V a and y = —Ja are asymptotically stable. 

27. (a) a < 0: y = 0 is asymptotically stable and y = a is unstable, 
a — 0: y = 0 is semistable. 

a > 0: y = 0 is unstable and y = a is asymptotically stable. 

pqUPto-P* - 1] 

28. (a) Inn x(t) = mm (p,q); x(t) = -——- 

t^oo q e u{q-p)t _ p 

p 2 at 

(b) lim x(t) = p\ x(t) = ———- 
*-►<» pat + 1 


Section 2.6, page 101 


1. x 2 + 3x + y 2 — 2y = c 
3. x 3 — x 2 y + 2x + 2y 3 + 3y = c 
5. ax 2 + 2bxy + cy 2 = k 

7. e x siny + 2y cosx = c; also y = 0 
9. e xy cos 2x + x 2 - 3 y = c 
11. Not exact 

13. y = [x + V28 - 3x 2 j/2, \x\ < 

14. y = [x — (24x 3 + x 2 — 8x — 16) 1/2 ]/4, 


2. Not exact 
4. x 2 y 2 + 2xy = c 
6. Not exact 
8. Not exact 
10. y lnx + 3x 2 - 2y = c 
12. x 2 + y 2 = c 


x > 0.9846 
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15. 

b = : 

$; x 2 y 2 

+ 2 x 3 y = c 


16. 

b — 1; e 2xy +x 2 = c 

19. 

x 2 + 

2 In \y\ - 

- y~ 2 = c; also y = 

0 

20. 

e? siny + 2y cosx = c 

21. 

xy 2 - 

- (y 2 - 2y + 2)e y = c 


22. 

x 2 e x sin y = c 

24. 

f*(t) ■ 

— exp J 

R(t) dt, where t = 

= xy 

25. 

fi(x) = e 3x \ (3x 2 y + 

26. 

H(x) 

= e~ x \ 

y = ce x + 1 + e 2x 




27. 

n(y) 

— y\ xy + y cosy — siny = 

= c 



28. 

n(y) 

= e 2y /y\ 

xe 2y — In \y\ = c; 

also y 

= 0 


29. 

n(y) 

= siny; 

e x sin y +y 2 = c 




30. 

ix(y) 

= /; ■ 

x 4 + 3xy +y 4 = c 




31. 

li(x,y) = xy; 

x 3 y + 3x 2 + y 3 = 

c 




Section 2.7, page 110 

1. (a) 1.2,1.39,1.571,1.7439 (b) 1.1975,1.38549,1.56491,1.73658 

(c) 1.19631,1.38335,1.56200,1.73308 (d) 1.19516,1.38127,1.55918,1.72968 

2. (a) 1.1, 1.22, 1.364, 1.5368 (b) 1.105, 1.23205, 1.38578, 1.57179 

(c) 1.10775, 1.23873, 1.39793, 1.59144 (d) 1.1107, 1.24591, 1.41106, 1.61277 

3. (a) 1.25, 1.54, 1.878, 2.2736 (b) 1.26, 1.5641, 1.92156, 2.34359 

(c) 1.26551, 1.57746, 1.94586, 2.38287 (d) 1.2714, 1.59182, 1.97212, 2.42554 

4. (a) 0.3,0.538501,0.724821,0.866458 (b) 0.284813,0.513339,0.693451,0.831571 

(c) 0.277920,0.501813,0.678949,0.815302 (d) 0.271428,0.490897,0.665142,0.799729 

5. Converge for y > 0; undefined for y < 0 6. Converge for y > 0; diverge for y < 0 

7. Converge 

8. Converge for |y(0)| <2.37 (approximately); diverge otherwise 

9. Diverge 

10. Diverge 

11. (a) 2.30800,2.49006,2.60023,2.66773,2.70939,2.73521 

(b) 2.30167,2.48263,2.59352,2.66227,2.70519,2.73209 

(c) 2.29864,2.47903,2.59024,2.65958,2.70310,2.73053 

(d) 2.29686,2.47691,2.58830,2.65798,2.70185,2.72959 

12. (a) 1.70308,3.06605,2.44030,1.77204,1.37348,1.11925 

(b) 1.79548,3.06051,2.43292,1.77807,1.37795,1.12191 

(c) 1.84579,3.05769,2.42905,1.78074,1.38017,1.12328 

(d) 1.87734,3.05607,2.42672,1.78224,1.38150,1.12411 

13. (a) -1.48849,-0.412339,1.04687,1.43176,1.54438,1.51971 

(b) -1.46909, -0.287883,1.05351,1.42003,1.53000,1.50549 

(c) -1.45865, -0.217545,1.05715,1.41486,1.52334,1.49879 

(d) -1.45212, -0.173376,1.05941,1.41197,1.51949,1.49490 

14. (a) 0.950517,0.687550,0.369188,0.145990,0.0421429,0.00872877 

(b) 0.938298,0.672145,0.362640,0.147659,0.0454100,0.0104931 

(c) 0.932253,0.664778,0.359567,0.148416,0.0469514,0.0113722 

(d) 0.928649,0.660463,0.357783,0.148848,0.0478492,0.0118978 

15. (a) -0.166134,-0.410872,-0.804660,4.15867 
(b) -0.174652, -0.434238, -0.889140, -3.09810 

16. A reasonable estimate for y at t = 0.8 is between 5.5 and 6. No reliable estimate is possible 
at t = 1 from the specified data. 

17. A reasonable estimate for y at t = 2.5 is between 18 and 19. No reliable estimate is possible 
at t = 3 from the specified data. 

18. (b) 2.37 < a 0 < 2.38 19. (b) 0.67 < ao < 0.68 
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Section 2.8, page 120 


1. dw/ds = (s + l) 2 + (w + 2) 2 , w(0) = 0 2. dw/ds = 1 — (w + 3) 3 , w(0) = 0 

n 2 k t k 

3. (a) 0„(7) = ~jT- ( c ) lim n—oo 0n(O = e 2 ' - 1 


4. (a) 0„(7) = 


k\ 

(-1 ) k t k 

k\ 


(c) lim^oo 0„(7) = e ' - 1 


5. (a) 0„(t) = (~l) k+1 t k+1 /(k + DI2*- 1 (c) linw 0„(t) = 4 e - (/2 + 2f - 4 


6 . (a) 0„(7) = 7 ■ 


ffl+1 


» (» + 1 ) ! f2 ,- 1 

7. (a) 0„(7) - Y l. 3 . 5 ... (2k - 1) 


(c) lim^oo (j) n {t) — ^ 


&=i 


n t 3k ~ 1 

8. (a) 0„(7) = - X) 2 • 5 • 8 • • • (3k - 1) 

t 3 ft 1 t 3 f 2t n t 15 

(a) 01 (7) = y, 02(7) = 3- + —, 03 ( 7 ) = - + — + 3-7-9-11 + (7.9)2 . 15 

7 4 f 4 37 7 3f 10 7 13 

10. (a) 0i(7) = 7; 02(0 = 7-^; 03(0 = 7-- + — -^-^ + ^-^ 

11. (a) 01 (7) = t, 0 2 (7) = 7— — + — — — + 0(t s ), 

2! 4! 0 ! 

t 2 t 3 t 4 7f 5 14t 6 „ . 

03(7) - t -^ + 3i + ^.~i\ + ~6r + ° (t) ’ 

t 2 t 3 7t 5 31r 6 „ 7 

04(7) _r-- + -- — + — + 0(0 

*3 

12. (a) 0i (0 = -t - 7 2 - —, 

t 2 f 3 t 4 t 5 t 6 _ . 

0 2 (7) = - f -2 + 6 + 4“5“24 + ° (0 ’ 

7 2 7 4 37 5 4t 6 ^ 7 

03(7) = -f-1-1-h 0(7'), 

2 12 20 45 

t 2 t 4 It 5 t 6 _ - 

0 4 (7 ) = -7- 2 + 8 - 60 + 15+0(7) 


Section 2.9, page 131 

1. y„ - (~l) n (0.9) n y 0 ; y„ 0 as n 00 

2. y„ = y 0 / (w + 1); y n ->■ 0 as n ->■ 00 

3 . y„ = yoV(« + 2)(n + l)/2; y„ —»■ 00 as n ->• 00 

yo, if n = Ak or n = 4k — 1; . .. . 

4. y„ = < . r ,, - ,, 7 y„ has no limit as« ->• 00 

l -yo, if n = 4k - 2 or n = Ak - 3; y 

5. y n = (O.Sl'Hyo — 12) + 12; y„ ->• 12 as n -> 00 

6. y n = (—l)"(0.5)"(y 0 - 4) + 4; y„ -s- 4 as n 00 

7. 7.25% 

8. $2283.63 

9 . $258.14 

10 . (a) $804.62 (b) $877.57 (c) $1028.61 

11. 30 yrs: $804.62/mo; $289,663.20 total 20 yrs: $899.73/mo; $215,935.20 total 

12 . $103,624.62 

13 . 9.73% 

16 . (b) u n -> —00 as n -> oo 

19 . (a) 4.7263 (b) 1.223% (c) 3.5643 (e) 3.5699 
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CHAPTER 3 


Miscellaneous Problems, page 133 


1 . 

3. 

5. 

7. 

9. 

11 . 

13. 

15. 

17. 

19. 

21 . 

23. 

25. 

27. 

29. 

31. 

34. 

35. 


36. 

37. 

38. 

39. 

40. 

41. 

42. 

43. 

44. 
46. 
48. 

50. 

51. 


y = (c/x 2 ) + (x 3 /5) 
x 2 -\-xy — 3y — y 3 = 0 
x 2 y + xy 2 + x = c 
x 4 + x — y 2 — y 3 = c 
x 2 y + x + y 2 = c 
(x 3 /3) + xy + e y = c 
y = tan(x + x 2 + c) 
y = c/cosh 2 (x/2) 

3 x 2x 

y = ce — e 

2 xy + xy 3 — x 3 = c 
2 xy 2 + 3 x 2 y — 4x + y 3 — c 


2. 2 y + cosy — x — sinx = c 
4. y = —3 + ce x ~ x2 
6 . y = x~ 1 (l - e l ~ x ) 

8. y = (4 + cos 2 — cos x) /x 2 
10. x + In |x| + x _1 + y — 2 In \y\ = c; alsoy = 0 
12 . y = ce~ x + e~ x ln(l + e x ) 

14. x 2 + 2xy + 2y 2 = 34 
16. e~ x cosy + e 2y sin x = c 

18. y = e~ lx f e~ s2 ds + Se" 2 ' 

Jo 

20. c* + e~y = c 

22. y 3 + 3y — x 3 + 3x = 2 

sin y sin 2 x = c 


(x 2 /y) + arctan (y/x) = c 
(x 2 + y 2 + l)c _y2 = c 
arctan (y/x) — In ^ x 2 + y 2 = c 

x 3 y 2 + xy 3 = —4 


-l 


(a) y = t + (c-t) 

(a) v' — [x(0 + b]v = b 


32. 

y 

(b) y = t~ l + 2t(c — t 2 )~ l 


26. e~y! x + In |x| = c 

28. x 3 + x 2 y = c 

30. (y 2 /x 3 ) + (y/x 2 ) = c 

1 f x e 2s 1 x 

- = -X / -rds+- 

y Ji s 2 2 

(c) y = sin t + (c cos t — \ sin t) _1 


(b) v = f n(t) dt + cj//r(t), ix{t) = exp[— (at 2 /2) — bt] 

y = c\t~ x + c 2 + lnt 
y = Ci In t + c 2 + t 

y = (1 /k) In |(A: — t)/{k + t)\ + c 2 if c\ = k 2 > 0; y = (2/A:) arctan(t/A) + c 2 if 
ci = —A 2 <0; y = —2t _1 + c 2 if c\ = 0; also y = c 

y = ±|(t — 2c\)y/t + ci + c 2 ; also y = c Hint: /x(v) = v~ 3 is an integrating factor, 
y = cic -r + c 2 — tc _r 

c 2 y = cit — In |1 + cit| + c 2 if ci 7 ^ 0; y = \t 2 + c 2 if ci = 0; also y = c 
y 2 = c x t + c 2 

y = ci sin(t + c 2 ) = Ai sin t + k 2 cos t 

|y 3 — 2ciy + c 2 = 2t\ also y = c 45. t + c 2 = ±|(y — 2ci)(y + Ci ) 1/2 

y In |y | - y + ciy + t = c 2 ; also y = c 47. e y = (t + c 2 ) 2 + ci 
y = f (f + 1) 3/2 - | 49. y = 2(1 - t) -2 

y = 3 In t — | ln(t 2 + 1) — 5 arctan t + 2 + | In 2 + |tt 

y = + | 


Section 3.1, page 144 

1. y = CiC r + c 2 c _3r 2 . y = cic -r + c 2 c _2r 

3. y = cic ?/2 + c 2 e~ t/3 4. y = cic ?/2 + c 2 e f 

5. y = ci + c 2 e~ 5t 6. y = cic 3r/2 + c 2 e~ 3t/1 

7. y = ci exp[(9 + 3\/5)t/2] + c 2 exp[(9 - 3>/5)t/2] 

8. y = ci exp[(l + V3)t] + c 2 exp[(l - V3)t] 

9. y = c ? ; y oo as t oo 

10 . y = |c _r — \e~ 3t \ y 0 as t oo 

11 . y = 12e t/3 — &e t/2 \ y — oo as t oo 

12. y = —1 — c _3f ; y — 1 as t oo 

13. y = ^(13 + 5\/l3) exp[(—5 + Vl3)t/2] + ^(13 - 5Vl3) exp[(-5 - Vl3)t/2]; y -> Oas 
t ^ oo 
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14. y = (2/>/33) exp[(-l + */33)t/4\ - (2/V33) exp[(—1 - V / 33)/ L /4]; y -> oo as t -> oo 

15. y = ^e _9(r_1) + y -> oo as t -> oo 

16. y = — i e (t+ 2)/2 _|_ 3 e -(r+2)/2. ^ _ 00 as t -> 00 

17. y"+y'-6y = 0 

18. 2y" + 5/ + 2y = 0 

19. y = minimum is y = 1 at £ = In 2 

20. y = — e l + 3e r/2 ; maximum is y = | at t = ln(9/4), y = 0 at £ = In 9 

21 . a = -2 

22 . p = -1 

23. y ^ 0 for a < 0; y becomes unbounded for a > 1 

24. y -> 0 for a < 1; there is no a for which all nonzero solutions become unbounded 

25. (a) y = \(1 + 2£)6T 2 ' + |(4 — 20)e*/ 2 (b) y = 0.71548 when t = § In 6 = 0.71670 

(c) 0 = 2 

26. (a) y = (6 + P)e~ 2t - (4 + P)e~ 3t 

(b) t m = ln[(12 + 3j8)/(12 + 20)], y OT = ±(6 + /J) 3 /(4 + 0) 2 

(c) 0 = 6(1 + V3) = 16.3923 (d) f m ln(3/2), y m -» oo 

27. (a) y = rf/c (b) aY" + by' + cY = 0 

28. (a) b > 0 and 0 < c < b 2 /^a (b) c < 0 (c) b < 0 and 0 < c < b 2 /4a 


Section 3.2, page 155 


1. -\ed 2 

2. 1 

3. 

4. x 2 e* 

5. — e 2t 

6. 0 

7. 0 < t < oo 

8. —oo < t < 1 

9. 0 < t < 4 

10. 0 < t < oo 

11. 0 < x < 3 

12. 2 < x < 3tt/2 

14. The equation is nonlinear. 

15. The equation is nonhomogeneous. 

16. No 

17. 3 te 2t + ce 2t 

18. te l ' 4- ct 

19. 5W(f,g) 

20. —4(tcos t — sint) 


21. y 3 and y 4 are a fundamental set of solutions if and only if a\b 2 — a 2 b\ ^ 0. 

22. yi(0 = |<r 2r + \e\ y 2 (t) = 

-b _2, +k 

23. yi(t) = — ig- 3 ^- 1 ) + 

y 2 (t) = —\e 3(r 1} + (? 1} 

24. Yes 


25. Yes 


26. Yes 

27. Yes 

28. (b) Yes (c) [yi(t),y3(0] and [yi(t),y4(0] are fundamental sets of solutions; 

I>2(0,;y3(0] and [y 4 (t),y 5 (t)] are not 

29. ct 2 e t 

30. c cos t 


31. c/x 32. c/(l — x 2 ) 

34. 2/25 35 3V^ = 4.946 

36. pit ) = 0 for all t 

If to is an inflection point, and y = 0(t) is a solution, then from the differential equation 
PihWik) + q(t 0 )(t>ito) = 0. 


42. Yes, y = 


r x 

y = c\e~ x2/2 / e t2/1 dt + c 2 e 
Jx 0 

—l r ^ 

(x) L J XI 


-x 2 /2 


y ll(x) 

y = C\X~ X 


dt + c 2 


43. No 

44. Yes, 

45. Yes, 

47. x 2 p" + 3xp' + (1 + x 2 - v 2 )p = 0 

48. (1 — x 2 )p" — 2xp' + a(a + 1 )p = 0 


x 0 

+ C 2 X 


l_iix) = exp — 


49. p" — xp = 0 


i-/g + ™h 


51. The Legendre and Airy equations are self-adjoint. 
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Section 3.3, page 164 


1 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

11 . 

13. 

15. 

17. 

18. 

19. 

20 . 
21 . 
22 . 

23. 

24. 

25. 


ecos2 + /esin2 = -1.1312 + 2.4717/ 

-1 

e 2 cos(7t/2) — ie 2 sin(7r/2) = — e 2 i = —7.3891/ 

2cos(ln2) — 2/sin(ln2) = 1.5385 — 1.2779/ 

7r _1 cos(21n7r) + in -1 sin(21n7r) = —0.20957 + 0.23959/ 
y = Cie 1 cos t + c 2 e r sin t 
y = c\e 1 cos V1 + c 2 e r sin V t 
y = c\e 2t + C 2 e~ 4t 


2. e 2 cos 3 - ie 2 sin 3 = -7.3151 - 1.0427/ 


y = c\e~ 3t cos 2 1 + c 2 e _3r sin 2 1 
y = c\e cos(t/2) + c 2 e _r sin(7/2) 
y = c\e~ t/2 cos t + c 2 e _r/2 sin t 
y = \ sin 2 1\ steady oscillation 
y — e~ 2t cos t + 2e~ 2t sin t ; decaying oscillation 


10. y = C\e t cost + C 2 e r sin t 
12. y — c\ cos(3t/2) + C 2 sin(3t/2) 


14. y — c\e tl3> + C 2 e 4t/3 
16. y = c\e~ 2t cos(3t/2) + c 2 e _2r sin(3t/2) 


y = 


_ pt—n/2 


sin 2 1\ growing oscillation 


y = (1 + 2 V3) cos t — (2 — V) sin t\ steady oscillation 

y — 3e~ t/2 cos t + \e~ tj2 sin t; decaying oscillation 

y = V e~ (f ~ lt/4) cos t + Vi e~^~ n/4) sin t; decaying oscillation 

(a) u = 2e t/6 cos(V23 1/6) - (2/V23)^ /6 sin(V23 1/6) (b) t = 10.7598 

(a) u = 2 e-7 5 cos(V34 1/5) + (7/V34) e~ t/5 sin(V34 1/5) (b) T = 14.5115 

(a) y = 2e- f cos V51 + [(a + 2)/V5] sin V t (b) a = 1.50878 

(c) t = {7T- arctan[2V5/(2 + a)]}/V (d) jt/V 


26. (a) y — e at cos t + ae at sint (b) T = 1.8763 


35. 

36. 

37. 
39. 
41. 

44. 

45. 

46. 


(c) a = T = 7.4284; a = 1, T = 4.3003; a = 2, T = 1.5116 
y = ci cos (In t ) + c 2 sin (In t ) 


y = dt 1 +c 2 t 2 


y = Cit 1 cos(| lnt) + c 2 £ 1 sin(|lnO 


y = dt 2 + c 2 t 3 


y = dt + c 2 r J 

Yes, y = d cosx + c 2 sinx, x = / 

No 

Yes, y = de~ t2/4 cos(\/3 1 2 / 4) + c 2 e~ t2/4 sin(V3 1 2 j 4) 


38. y = Cit 6 + c 2 t~ l 
40. y = dt cos(2 In t) + c 2 t sin(2 In t) 
42. y = cit -3 cos (In t) + c 2 t -3 sin(ku) 

e~ t2/1 dt 


Section 3.4, page 172 


1 . 

3. 

5. 

7. 

9. 

11 . 

12 . 

13. 

14. 

15. 


16. 

17. 


y = C\6 t + C 2 te t 

y = de~ t/2 + c 2 e 3r/2 
y = cos 3/ + c 2 e r sin 3/ 
y = de~ t/4 + c 2 e _4r 

y = dV 15 + C 2 te lt/5 

y = 2e 2t/3> — \tV 13 , y —oo as t 

y = 2 te 3t , y oo as t oo 

y = — cos 3 ^ |g -^/3 s i n 3 ^ y 

y = 7 g- 2 ( ?+1 ) + 5tc _2(r+1) , y 0 as t 


2. y = cic _?/3 + C 2 te~ t/3 
4. y = cic _3r/2 + C 2 te~ 3t/2 
6. y = Ci^ 3r + c 2 te 3r 
8. y = ci^ _3r/4 + c 2 te~ 3tl4 
10 y = e _r/2 cos(t/2) + c 2 e~ tl2 sin(z t /2) 

00 

0 as t oo 
-> 00 


(a) y = e 3t/2 — \te 3t/1 (b) t = | 

(c) t 0 = 16/15, y 0 = — |e _8/5 = —0.33649 

(d) y = ^~ 3r / 2 + (b + | )te~ 3t/1 ; b = — \ 

y = 2^ /2 + (6 - l)te ?/2 ; 6 = 1 


(a) y = e-*' 2 + ffe- r/2 (b) t M = |, = 5^- 4 / 5 = 2.24664 

(c) y = e~ t/2 + (6 + |)tc _r/2 

(d) t M = 46/(1 + 26) 2 as 6 oo; y M = (1 + 26) exp[—26/(1 + 26)] -> oo 


as 6 


oo 
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18. (a) y = ae 2t/3 + (| a - 1 )te 2t/3 (b) a = \ 

23. y 2 (t) = t 3 

24. y 2 (t) = r 2 

25. y 2 (t) = t~ l In t 
27. y 2 (x) = cosx 2 
29. y 2 (x) = x 1/4 e~ 2 ^ 

3 i . y = ci ^-^ 2 / 2 r e &2/2 ^+ c 2 ^-^ 2/2 

Jo 

33. y 2 (t) = t _1 In t 
35. y 2 (x) = x 
38. (b) y 0 + (a/b)y 0 
41. y = c\t ~ 1/2 + c 2 t _1/2 In t 
43. y = c\t~ x + c 2 t _1 In t 
45. y = C\t ~ 2 cos(3 In t) + c 2 t~ 2 sin(3 In t) 

Section 3.5, page 184 

1 . y = c\e 3t + c 2 e~ l — e 2t 

2 . y = c\e cos 2t + c 2 e~ l sin 2t + ^ sin 2t - cos 2t 

3. y = c\e t -f- c 2 c 2t — ^ 4~ 3t — 2t 2 

4. y = cie 2t + c 2 e _3r + 2e 3t - 3e~ 2t 

5. y = cie 3r + c 2 c _r + y^te^ + |t 2 e _r 6. y = c\ + c 2 c _2? + |t — \ sin2t — \ cos2t 

7 . y = ci cos 3t 4- c 2 sin 3t + ^ (9t 2 — 6t + l)e 3r + | 

8. y = cie~ l + c 2 te _r + t 2 e _r 

9. y = cie -r + c 2 e~ t/2 + t 2 - 6t + 14 - ^ sin t - ^ cos t 

10. y = ci cos t + c 2 sin £ — 11 cos 2t — ~ sin 2t 

11. u = ci cos coot + c 2 sin &> 0 t + (&>o — &> 2 ) -1 cos cot 

12. u = Ci cos + c 2 sin coot + (1 /2 co 0 )t sin oj 0 t 

13. y = cie~ t/2 cos(Vl5 1/2) + c 2 e~ t/2 sin(Vl5t/2) + \e f — \e~ l 

14. y = cie~ l + c 2 e 2r + \te 2t + |e _2? 

15. y — e l — I e ~ 2t ~t—\ 

16. y = ^ sin2t - ^ cos2t + |t 2 - \ 17. y = 4tE — 3e l + |tV + 4 

18. y = e 3t + \e~ l — ^e 2t - te 2t 19. y = 2cos2t - | sin2t - |tcos2t 

20. y = cos 2t +\ e~ f sin 2t + te~ l sin 2t 

21 . (a) Y( t ) = t{Aot 4 + yli ^ 3 + A 2 ^ 2 + yl 3 ^ + A 4 ) + t{Bot 2 + + -6 2 )c 3? 

+ Z) 8^3^ + Ecos3t 

(b) Ao = 2/15, Ai = -2/9, A 2 = 8/27, A 3 = -S/21, A 4 = 16/81, B 0 = -1/9, 

Bi = -1/9, B 2 = -2/27, D = -1/18, E = -1/18 

(a) (^) = A 0 t Ai t{Bot -\~ BA sin t -b t{Dot 4- DA cos t 

(b) Ao = 1, Ai = 0, B 0 = 0, Bi = 1/4, D 0 = -1/4, D x = 0 

23. (a) Y(t) = e t (Acos2t + 5sin20 + (Dot + Di)e 2t sin/ 1 + (E 0 t + Ei)e 2t cost 

(b) A = -1/20, B = -3/20, D 0 = -3/2, D x = -5, £ 0 = 3/2, ^ = 1/2 

(a) Y ( t ) = t{Bot 2 -\~ Bit -\~ BAc t cos t t(Dot 2 4- Dit 4~ DAc t sin t 

(b) A = 3, Bo = -2/3, Bi = 0, B 2 = 1, D 0 = 0, D x = 1, D 2 = 1 

25. (a) Y(0 = A 0 £ 2 + Ait + A 2 + t 2 06 o t + ^i)e 2r + + DA sin 21 + + ^ 1 ) cos2t 

(b) A 0 = 1/2, A x = 1, A 2 = 3/4, = 2/3, ^ = 0, D 0 = 0, D x = -1/16, 

Eo = 1/8, = 1/16 

(a) Y(t) — t{Aot 2 4~ Ait 4~ A 2 ) sin2t 4~ t(Bot 2 4~ Bit 4~ ^ 2 ) cos 2t 

(b) A 0 = 0, Ax = 13/16, A 2 = 7/4, = -1/12, ^ = 0, B 2 = 13/32 

(a) Y(t) = (A 0 t 2 4~ Ait 4~ A 2 )c‘ f ' sin 21 4~ {Bot 2 4~ Bit 4~ BAE cos 2t 4~ 
c _r (Z) cos t + E sin t) + Fe f 

(b) A 0 = 1/52, Ai = 10/169, A 2 = -1233/35,152, B 0 = -5/52, 5i = 73/676, 

£ 2 = -4105/35,152, D = -3/2, E = 3/2, F = 2/3 


26. y 2 (t) = te 1 
28. y 2 (x) = x 
30. y 2 (x) = x _1/2 cosx 

32 . y 2 w =yi(01 ex P [-£ /?(r) Jrj ds 

34. y 2 (t) = cost 2 
36. y 2 (x) = x _1/2 cosx 
40. y = ci t 2 + c 2 t 2 In t 
42. y = cit 4- c 2 t 5/2 
44. y = cit 3 ' 2 + c 2 t 3/2 In t 
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28. 


29. 


30. 


31. 


32. 


33. 

36. 


(a) Y(t) = t(A 0 t + A 1 )e 1 cos2t + t(B 0 t + Bi)e f sin2t + (D 0 t + Di)e 2t cos t + 
(E 0 t + Ei)e~ 2t sin t 

(b) A 0 = 0, A x = 3/16, B 0 = 3/8, B t = 0, D 0 = -2/5, D x = -7/25, E 0 = 1/5, 
E x = 1/25 

(b) w = + cie 5t 

N 

y = C\ cos Xt + c 2 sin Xt + J2 UWC^ 2 — w 2 7T 2 )] sin rmzt 

m =1 


= 

= 

No 


t, 

— (1 + 7r/2) sin t — (tt/2) cos t + {it/2)e n ~ t , 

\ sin2t — |e _? cos20 

— | (1 + e 7r/2 )c _r cos 2t — ^ (1 + e 71 / 2 )^ sin 2t, 


0 < t < 7T 
t > 7T 

0 < t < 7t/2 
t > 7T/2 


y = CiC 4r + C 2 e r - |c 2? 


Section 3.6, page 190 


1. 

3. 

5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 
17. 

19. 

23. 

24. 

25. 

26. 

30. 

32. 


Y(t) = e f 2. Y(t) = -§fcr* 

y(0 - §0e-‘ 4. y(o = 2t 2 e t/2 

y = ci cos t + c 2 sin t — (cos t) ln(tan t + sec t) 
y = ci cos 3 1 + c 2 sin 3t + (sin 30 ln(tan 3 1 + sec 30 — 1 
_y = cie~ 2t + c 2 te~ 2t — e~ 2t In t 

y = c i cos 2t + c 2 sin 2t + | (sin 20 In sin 2t — |t cos 2t 
y = ci cos(t/2) + c 2 sin(t/2) + t sin(t/2) + 2[ln cos(t/2)] cos(t/2) 
y = ciO + c 2 tO — |0 ln(l + t 2 ) + tO arctan t 

y = cie 2t + c 2 e 3t + J [e 3(t ~ s) - e 2(t ~ s) ]g(s) ds 

y — ci cos 2 1 + c 2 sin 2t + \ J [sin 2{t — s)]g(s) ds 

Y(t) = \+t 2 \nt 
Y(t ) = -20 


y(o = |(* - 1 )^ 

Y(x) = gx 2 (lnx ) 3 
C xe f — fe* 

yw = /(T^^ 


(b) y = yo cos ^ sin t + / sin(t — s)g(s) ds- 

t tQ 

y = (b — a)- 1 [ [e Ht ~ s) - e a(t ~ s) ] g(s) ds 

t k) 

y = ji~ x f sin ix{t — s)g(s) ds 

t tQ 

y = f (t — s)e a(t ~ s) g(s) ds 
JtQ 


16. y(0 = —^(2t — l)e~ f 
18. Y(x) = - |x 1/2 cos x 

20. YQc) = x~ 1/2 J t~ 3/2 sin(x - t)g(t) dt 


y = cit 1 +c 2 t 5 + 
y = cie f + c 2 t — \(2t — 1 )e~ t 


29. y = Cit + c 2 0 + 40 In t 

31. y = Ci(l + 0 + c 2 0 + ^(^ — l)c 2r 


Section 3.7, page 203 

zi = 5 cos(2^ — 5), 8 = arctan (4/3) = 0.9273 

2. u = 2 cos (t — 27 t/3) 

3. u = 2V5cos(3 1 - 8 ), 5 = - arctan(l/2) = -0.4636 

4. u = Vl3cos(77t — 5), 5 = 7r + arctan(3/2) = 4.1244 

5. u = \ cos 8 1 ft, t in s; go = 8 rad/s, T = n/4 s, R = 1/4 ft 

6. u = ^ sin 14t cm, t in s; t = 7 t/14 s 
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7. 

8 . 
9. 

10 . 

11 . 

12 . 

13. 

16. 

17. 

20 . 

23. 

25. 

26. 


27. 

28. 

29. 

30. 
32. 


u = (l/4\/2) sin(8\/20 - ^ cos(8a/20 ft, t in s; <x> = 8>/2 rad/s, 

T — 7 T/ 4 V 2 s, i? = y11/288 = 0.1954 ft, 8 = tt — arctan(3/V2) = 2.0113 
Q = 10 - 6 cos2000£ C, tin s 

u = c _ 10 r [2cos(4 V6t) + (5/V6) sin(4^60] cm, t in s; 

/x = 4>/6 rad/s, T d = tt/2V6 s, T d /T = 1 /2\f6 = 1.4289, r = 0.4045 s 
w = (l/8V3T)e _2r sin(2\/3l0 ft, ^ in s; t = n/2\/31 s , r = 1.5927 s 
w = 0.057198^-° 15r cos (3.87008 1 - 0.50709) m/ins; /x = 3.87008 rad/s, 

/x/coo = 3.87008/V15 = 0.99925 
Q = 10- 6 (2e~ 5m - e - lom ) C; tin s 
y = y2079 = 1.4907 

r = V^4 2 + B 2 , rcos0 = B, rsinO = —A; R = r; 5 = 0 + (4 n + 
n = 0 , 1 , 2 ,... 


y = 8 lb-s/ft 
i>o < —yuol2m 
y = 5 lb-s/ft 
(a) r = 41.715 

(a) u(t) = e~ yt / 2m 


18. R = 10 3 Q 

22. 27T/y3l 

24. k = 6, v = ±2^5 


(d) yq = 1.73, min r = 4.87 (e) r = (2/y) ln(400/y4 — y 2 ) 

^oy4/cm — y 2 cos jit + ( 2mvo + ywo) sin/x^J 1^14km — y 2 


(b) R 2 = 4m(kul + yu^vo + mvl)/(4km — y 2 ) 
plu" + pogu = 0, T = 2tz^J pl/pog 
(a) u = V2 sin \f21 (c) clockwise 

(a) u = (16/yi27)e -r/ 8 sin(yi27 t/S) (c) clockwise 

(b) u = acos(y/k/m t ) + b^/m/k sin (y/k/m t ) 

(b) u = snU, A = 1, T = 2tt (c) A = 0.98, T = 6.07 

(d) 6 = 0.2, A = 0.96, T = 5.90; e = 0.3, A = 0.94, T = 5.74 

(f) 6 = -0.1, A = 1.03, T = 6.55; 6 = -0.2, A = 1.06, T = 6.90; 6 = -0.3, 

A = 1.11, T = 7.41 


Section 3.8, page 217 

1. —2 sin St sin t 2. 2sin(7/2) cos(13/ L /2) 

3. 2 cos( 37 i 7 / 2 ) cos(tt£/2) 4. 2sin(7£/2) cos(t/2) 

5 . w" + 256w = 16 cos 3£, w(0) = |, w'(0) = 0, win ft, dns 

6 . w" + 10w' + 98 u = 2 sin(//2), w(0) = 0, w'(0) = 0.03, u in m, t in s 

7. (a) u = cos 16^ + ^ cos 3£ (c) <x> = 16 rad/s 

8. (a) u = [160c _5r cos(V73 1) + 3 7300 3 e ~ 5t sin(y73 1) — 160cos(^/2) + 

3128 sin(/ L /2)] (b) The first two terms are the transient. (d) <x> = 4\/3 rad/s 

9. w = ^ (cos It - cos 8 1 ) = ^ sin(/ : /2) sin(15^/2) ft, t in s 

10. u = (cos 8 1 + sin St — St cos 80/4 ft, t in sec; 1/8, jt/S, n/4, 3 jt/S s 


11. 

(a) (30 cos 21 + sin 20 ft, t in s 

(b) m = 4 slugs 

12. 

u = (a/2/6) cos(3£ — 3jt/4) m, t in s 




Fo(t — sin 0, 

0 < t < 7T 

15. 

u = 

F 0 [(27t - 0 - 3 sinO, 

7T < t <2 jt 



—4F 0 sin t. 

2 jt < t < 00 


16. Q(t) = 10- 6 (e- 4000t - 4e~ 1000t + 3) C, t in s, Q(0.001) = 1.5468 x 10“ 6 ; 

2 ( 0 . 01 ) = 2.9998 x 10 - 6 ; Q(t) -> 3 x 10“ 6 as 00 

17. (a) u = [32(2 — <x> 2 ) cos cot + 8 co sin<x)0/(64 — 63<x> 2 + 16 cd 4 ) (b) A = 8/V64 — 63<x> 2 + 16 cd 4 

(d) w = 3yi4/8 = 1.4031, A = 64/VVXl = 5.6791 

18. (a) u = 3(cos t — cos cot)/(co 2 — 1 ) 

19. (a) u = [(co 2 + 2) cos t — 3 cos <x>0 /(&> 2 — 1) + sin t 
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CHAPTER 4 Section 4.1, page 226 


1 . —oo <£<oo 2 , £ > 0 or £ < 0 

3. £ > 1, or 0 < £ < 1, or £ < 0 4. £ > 0 

5. ..., —37t/ 2 < x < — 7 t/2, —7t/ 2 < x < 1, 1 < x < 7 t/2, 7t/ 2 < x < 37 t/2, ... 

6 . —oo < x < — 2 , — 2 < x < 2 , 2 <x<oo 

7. Linearly independent 

8 . Linearly dependent; /i(£) + 3/ 2 (£) - 2/ 3 (£) = 0 

9. Linearly dependent; 2 /i(£) + 13/2(0 — 3 / 3(0 — 7 / 4(0 = 0 

10. Linearly independent 

11 . 1 

12 . 1 

14. c~ 2r 

16. 6 /x 

19. (a) «o[^(^ — l)(w — 2) • 


(b) (a 0 r n + air n 

(c) e\ e~\ e 2t , e ~ 2t ; 

21. W(0 = c<r 2r 

22 . W(t) = c 

23. W(£) = c/t 2 

2 y = cic ? -b c 2 £ -P c 3 tc t 


13. —6e~ 2t 
15. 6 x 

17. sin 2 £ = L ( 5 ) _ 1 C os 2£ 

■ • 1] + — 1) • • • 2]£ H-b 

+ 


yes, W(e\e 1 ,e 2 \e 2t ) ^ 0, —oo < £ < oo 


24. W(£) = c/t 

y = Cit 2 + C 2 £ 3 -p C 2 (£ -p 1 ) 


Section 4.2, page 233 

1. a/ 2 ^'[( 7r / 4 )+ 2m7r ] 

^^i(^r+2m7r) 

5. 2c i[(ll7r/6)+2m7r] 

7. 1, |(-l + iV3), |(-l-iV3) 
9. 1, i, -1, -i 

11 . y = c\e l + c 2 £c r + c 3 e~ l 
13. y = C \e l + c 2 c 2r + c 3 c _? 


2 . 2 e i[(27zr / 3 ) +2m7r] 

4. ^i[(37r/2)+2m7r] 

6. y^g i '[(5jr/4)+2m7r] 

8 . 2 1/4 e~ ni/8 , 2 1 / 4 c 77n/8 

10 . (V3 + i) /V2, - (V3 + i) /V2 

12 . y = ci^ + c 2 £c r + c 2 £ 2 e* 

y = Ci + c 2 £ + c 3 c 2t -P c 4 £c 2? 


15. y = ci cos £ + c 2 sin £ + e^ t/2 (c 3 cos \£ + c 4 sin |£) + c ^ t/2 (c 5 cos \t + c 6 sin l£) 

16. y = cic r + c 2 c _r + C 3 C 2r + c 4 c _2r 

y = CiC ? -p C 2 £C ? -p c 3 t 2 6 t -P c 4 c f -p C 5 £C t -P C^t 2 6 t 

18. y = d + c 2 t + c 3 c r + c 4 c _r + C 5 cos £ + C 6 sin £ 

19. y = d + c 2 c r + C 3 c 2 ^ + c 4 cos £ + C 5 sin £ 

20 . y = c ! + c 2 c 2r + c r (c 3 cos V3 £ + c 4 sin V3 £) 

21 . y = c r [(ci + c 2 £) cos £ + (c 3 + c 4 £) sin £] + e~ l [{cs + c^t) cos £ + (c 7 + c 8 £) sin £] 

22. y = (ci + C 2 £) cos £ + (C3 + c 4 £) sin £ 

23. y = c\e f + c 2 c (2+ ^ )r + c' 3 c (2_v ^ 

24. y = cic _r + c 2 c (_2+x/2)? + c 3 e^~ 2 ~'^ 22)t 

25. y = c\e~ t/2 + c 2 c _?/3 < 

26. y = CiC 3r + c 2 c _2r + c 3 c (3+A/3)r + c 4 c (3_ ^ 3)r 

27. y = cic _r/3 + c 2 c _r/4 + c 3 c _? cos2£ + c 4 c _f sin2£ 


s(£/V3) + C 3 C 1/3 sin(£/V3) 


*- 2 i. 


28. y = cic r cos £ + C 2 C r sin £ + C 3 C 

29. y = 2-2 cos £ + sin £ 

30. y = lc-7^sin(£/V2) - l^sin(£/V^) 

31. y = 2£ - 3 

33. y = - fc* - y 2t - \e 
35. y = 8 - 18c-7 3 + 8 c-7 2 


(a /3 0 + c 4 c 2r sin(V3 £) 


32. y = 2 cos £ — sin £ 

34. y = + ff e r/2 cos £ + ^c r/2 sin £ 

17V3 


36. y = jle r cos £ — ||c 1 sin £ — ^c 2? cos(V3 £) H——— e 2t sin(>/3 £) 


39 
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37. y = | (cosh t — cos t) + \ (sinh t — sin t) 

38. (a) W(t) = c, a constant (b) W(t) = -8 (c) W(t) =4 

39. (b) u\ — c\ cos t + C2 sin t + C3 cos \/6 1 + c 4 sin V6t 

Section 4.3, page 239 

1 . y = c\e l + C 2 te t + c 3 e~ r + |tc _r + 3 

2. y = c\ e l + c 2 c _r + C3 cos t + c 4 sin t — 3t — |t sin t 

3. y = C\e~ l + c 2 cos t + c 3 sin t + ^tc _r + 4(t — 1) 

4. y = ci + c 2 c ? + c 3 c _r + cos t 

5. = ci + c 2 t + c 3 e~ 2t + c 4 c 2/ - |c* - Yt 4 - ^t 2 

6. = ci cos t + c 2 sin t + c 3 t cos t + c 4 t sin t + 3 + \ cos 2t 

1. y = d+ c 2 t + c 3 1 2 + c 4 c _r + c' /2 [c 5 cos(V3 t/2) + c 6 sin(V3 1/2)\ + ^t 4 

8. 3; = ci + c 2 t + c 3 t 2 + c 4 c _r + ^ sin2t + ^ cos2t 

9. y = -|(1 - cos20 + \t 2 

10. y = (t — 4) cos t — (|t + 4) sin t + 3t + 4 

11 . y — 1 + | (t 2 + 30 — te f 

12. cost — | sint + ^c _r + |jC r + ||c _3r + § cos2t - ^ sin2t 

13. Y(0 = t(A 0 t 3 + A x t 2 + A 2 t + A 3 ) + fltV 
y (0 = t(A 0 t + Ai)c _r + B cos t + C sin t 

15. y(0 = AtV + 5 cos t + C sin t 

16. y (0 = At 2 + {Bot + £1)^ + t(C cos 2t + D sin 2t) 

y(0 — t(A 0 t 2 Ait 4- A 2 ) -|- (yB^t + -61) cos t + (C 0 t + Ci) sin t 

18. y(t) = Ac ? + (2? 0 t + Bi)e~ f + tc _r (C cos t + £> sint) 

19. &o — a o > k n = aoa n + aic/* -1 + • • • + 


Section 4.4, page 244 


1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 


8 . 


9. 

10 . 

11 . 

12 . 

13. 

14. 


15. 


y = c\ + c 2 cos t + c 3 sin t — In cos t — (sin t) ln(sec t + tan t) 

y = Cl + c 2 c ? + c 3 *r r - \t 2 

y = C\e f + c 2 *r r + c 3 e 2r + ^ e At 


y = ci + c 2 cos t + C3 sin t + ln(sec t + tan t) — t cos t + (sin t) In cos t 

_y = Ci e l + c 2 cos t + C3 sin t — ^e~ f cos t 

y = ci cos t + c 2 sin t + C3t cos t + c 4 t sin t — 11 2 sin t 

_y = CiC r + c 2 cos t + c 3 sin t — ^ (cos t) In cos t + | (sin t) In cos t — |t cos t 


- ^tsint + ^c ? 





y = Ci + c 2 c r + c 3 c 1 — In sin t + ln(cos t + 1) + 



+ 


" /'(' ,/sins ) 




Ci = 0, c 2 = 2, c 3 = 1 in answer to Problem 4 

ci — 2, c 2 = \, c 3 = — c 4 = | in answer to Problem 6 

ci = |, c 2 = |, c 3 = — |, t 0 = 0 in answer to Problem 7 

ci = 3, c 2 = 0, c 3 = — c 71 / 2 , t 0 = 7 t/ 2 in answer to Problem 8 


ds 


Y(x) = x 4 /15 


Y(t) = 


Y(t) = 


1 

2 


1 

2 


f 

Jto 

f 

JtQ 


[e f s — sin(t — s) — cos (t — s)]gC?) ds 
[sinh(t — s) — sin(t — 5)]g(5) ds 
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16. Y(t) = \ f e (r s \t — s) 2 g(s) ds; Y(t) =—te f \n\t\ 

17. Y(x) = ± [ [(x/t 2 ) - 2{x 2 /t 3 ) + (x 3 /t 4 )]g(t) dt 

Jxa 


CHAPTER 5 Section 5.1, page 253 


t-H 

II 

Q. 

2. 

<N 

II 

Cl 

p = 00 

4. 

p=\ 

p = 1 

6. 

P = 1 

p = 3 

8. 

p = e 

~ (-l)"x 2n+1 

/ --—, p = oo 

“ (2n + l)! 

10. 

iM* 

S.J 7= 

II 

8 

1 + (x - 1), p = oo 

12. 

1 — 2(x + 1) + (x 4- l) 2 , 

B i)"+ i ^ _1) ", P = i 

n=l 

14. 

OO 

^(-irx", p = 1 

n=0 

II 

Q. 

16. 

oo 

j^(-ir +i ( X -2r, P 


17. y' — 1 + 2 2 x + 3 2 x 2 + 4 2 x 3 + • • • + (n + X) 2 x n + • • • 

/' = 2 2 + 3 2 • 2x + 4 2 • 3x 2 + 5 2 • 4x 3 4-h (n + 2) 2 (w + l)x n 4- 

18. y' — a\ + 2a 2 * + 3«3X 2 + 4a 4 x 3 + ••• + (« + l)a„+ix n 4- 

oo oo 

= na n x n ~ x — + l)a n+ ix n 

n=l n=0 

y" — 2a 2 4- 6a 2 x -\~ 12$4X 2 4~ 20£?5X 3 4~ • • • 4~ (yi 4~ 2)(/z 4~ l)^ n _|_ 2 -^ n ~h • • • 

oo oo 

= y^n(n — 1 )a n x n ~ 2 = + 2)(/t + l)a n+ 2 X n 


21. ^(/i + 2)(w + l)a n+2 x n 

n =0 
oo 

22. T; a n -2X n 

n=2 
oo 

23. + 1)^” 

n=0 

oo 

25. [(« + 2)(n + l)a n+2 + na n ]x n 

n =o 
oo 

27. y^[Qz + l)«fl w+ i + a n ]x n 


24. ^ [(« + 2)(/t + l)fl n+ 2 — n(« — l)a n ]x n 

n=o 

oo 

26. «i + ^ [(« + l)fl n +l + 0,i-l]x" 


28. = (— 2) n ao/n\, n = 1,2,...; 


Section 5.2, page 263 

1. (a) a„ +2 = fl„/(n + 2)(n + 1) 

2 4 v 6 oo 

A ^ A 

(b, d) y x {x) = 1 + — + — + — + •■• = £ 


2! 4! 6! 

3 5 7 00 

XXX x ' 

y 2 ( X ) = x+ - + - + - + -.- = ^ 


n =0 
v 2n+l 


( 2 «)! 


= cosh x 


(2n + l)! 


= sinh x 
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2 . (a) a n+2 =a„/(n + 2 ) 

X 2 X 4 X 6 

(b,d) yi(*) = l + - + — + 2^6 


x 3 x 5 x 7 

y 2{x) =X+ - + — + 


■ = E 

n=0 


00 v 2n 

E X 

2 n nl 

n =o 

2 n «!x 2 " +1 
(2n +1)! 


3. (a) (n + 2)a„ +2 - a„+i - a„ = 0 

(b) ydx) = 1 + \{x - l) 2 + \{x - l) 3 + \{x - l) 4 H- 

y 2 (x) = (x - 1) + \{x - l) 2 + \{x - l) 3 + \{x - l) 4 H- 

4. (a) a n+ 4 = —k 2 a n /(n + 4)(n + 3); «2 = «3 = 0 

k 2 y 4 k 4 y 8 k 6 r 12 

AV A /V A A, A 

<M) = 1 - jTj + j-j-y-g- 


3.4.7.8 • 11 • 12 


= 1 + E 


(-l) m+1 (fc 2 x 4 ) m+1 


3 • 4 • 7 • 8 • • • (4m + 3) (4m + 4) 


k 4 x 9 


k 2 x 5 

y 2 (x) = x- — + 4 . 5 . 8 . 9 


k 6 x 13 


4 • 5 • 8 • 9 • 12.13 


( —l) m+1 (£ 2 X 4 ) m+1 

+ 2^ 4 • 5 • 8 • 9 • • • i 


m=0 


4 • 5 • 8 • 9 • • • (4m + 4) (4m + 5) 


Hint: Let rz = 4m in the recurrence relation, m = 1,2,3,... . 

5. (a) (n + 2){n + l)a n+2 — n(n + l)a n+ i + a n = 0, n > 1; a 2 = — 

(b) yi(x) = 1 - lx 2 - lx 3 - ^x 4 + • • •, y 2 (x) = x - \x 3 - ^x 4 - 

6. (a) a n+2 = — (n 2 — 2n + 4)a„/[2(n + \){n + 2)], n >2; a 2 = —ao, 

(b) y\ (x) = 1 - x 2 + ix 4 - ^x 6 H-, 

yi{x) = X jX + j^qX 192qX + ' * ' 


7. (a) «„ +2 = -a n /(n + 1), 


n = 0,1,2,... 


X 2 X 4 

(b,d)„ w =l- T +—- — 

^ x X 3 X 5 X 7 

I2W = X - — + 7 “ o 4 ^ 

2 2-4 2*4-6 


+ 


00 ( 1 \ n Jin 

... = i + V—-—-— 

^ 1 • 3 • 5 • • • (2n 
y (~l) n x 2n+1 
X “ 2 • 4 • 6 • • • ( 2n ) 

n=l 

8. (a) a n+2 = -[(« + l) 2 a n+1 +a n + a n -i]/(n + 1 ){n + 2), « = 1,2,... 

#2 — — (^0 + a l )/2 

(b) yi(x) = 1 - \{x - l) 2 + \{x - l) 3 - 2 -{x - l) 4 + • • • 
y 2 (x) = (X - 1) - \{x - l) 2 + \{X - l) 3 - \(x - l) 4 + • • • 

9. (a) (n + 2)(n + 1)^+2 + (n — 2)(n — 3)« n = 0; n = 0,1,2,... 

(b) (x) = 1 — 3x 2 , y 2 (x) = x — x 3 /3 

10. (a) 4{n + 2)a n+2 — (n — 2)a n = 0; n = 0,1,2,. 


(b,d) yi(x) = 1 - y, 


3/2 (X) X 12 240 2240 


4” (2 n - 


11. (a) 3(n + 2 )a n+2 — (n + l)fln = 0; n = 0,1,2,. 


(b,d) v,(x) _! + - + - + —x 6 + • • • + 


, , 2 3 8 5 16 7 
, 2( x)=x + -x 3 + — x 3 + — x 2 + ... + 3 ^ 3 ^ 5 


3 * 5 * * * (2n - 1) 
3"-2*4**-(2 n) J 

2 • 4 • • • (2n) 


r 2n+l 


+ 


• (2/r + 1) 

12. (a) ( n + 2 ){n + l)fl n+ 2 — (n + l)rza n+ i + (n — l)a n = 0; n = 0,1,2,.. 


X 2 X 3 X 4 x n 

(b’d) >'iW = 1 +y + -g +24+-" + ^ + - 


y 2 (x) =x 


c 5 + • • • 

«3 = -J«l 


1) 


.2ft+1 

l)(2n +1) 
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13. (a) 2(n + 2)(n + l)a n+ 2 + (n + 3)a n = 0; n = 0,1,2, 


(b, d) y, (x) = 1 - ^x 2 + |x 4 - 2^x 6 + ■ 


3.5...(2n + l) 
2"(2n)! 


x x X 3 X 5 X 7 


.+(-!)■ 4 _ 6 '.: (2 ". + . 2> -t a '*'+- 


2 n (2n +1)! 

(a) 2(n —|— 2 )(/2 — |— l )^ n _|_2 4~ 3(zz 4~ l)^ n _|_i 4~ (zz 4~ 3)a n — O 5 zz = 0,1,2, 

(b) yi(x) = 1 - f (x - 2) 2 + |(x - 2) 3 + ±(x — 2) 4 H- 

y 2 (x) = (x - 2 ) - f(x - 2) 2 + i(x - 2) 3 + £(x - 2) 4 + ■ • ■ 

15. (a) y = 2 + x + x 2 + |x 3 + Jx 4 + • ■ • (c) about |x| < 0.7 

16. (a) y = — 1 + 3x + x 2 — |x 3 — |x 4 + • • • (c) about |x| < 0.7 

17. (a) y = 4 — x — 4x 2 + ^x 3 + |x 4 H- (c) about |x| < 0.5 

18. (a) y = — 3 + 2x — |x 2 — \y? — |x 4 + • • • (c) about |x| < 0.9 

19. (a) yi(x) = 1 - §(x - l ) 3 - ^(x - l ) 4 + ±(x - l ) 6 + • • • 

y 2 (x) = (x - 1) - |(x - l ) 4 - i(x - l ) 5 + i(x - l ) 7 4- 

21 . (a) yi(x) = 1 - —x 2 + —-—x 4 - — - x b H- 


y 2 (x) = x - 


4! 

I 3 , (A-2)(A-6) 5 
-x J 4- v ■ 


(A- 


2) (A — 6) (A — 10) 7 
-7!- X + ' 


3! " ' 5! 

(b) 1, x, 1 — 2x 2 , x - |x 3 , 1 - 4x 2 + |x 4 , x - |x 3 + ^x 5 

(c) 1, 2x, 4x 2 - 2, 8x 3 - 12x, 16x 4 - 48x 2 + 12, 32x 5 - 160x 3 + 120x 
22 . (b) y = x — x 3 /6 + • • • 


Section 5.3, page 269 


1 . 

4 >"( 0 ) = 

-1, 

r 

'(0): 

= 0, 

0 (4) ( 0 ) = 3 



2 . 

r(0) = 

o, 

r 

'(0): 


o 

II 

o 

<N 



3 . 

rd) = 

0 , 

r 

'(1) = 


(N 

Ti¬ 

ll 

\D 


4 . 

*"(0) = 

0 , 

r 

'(0): 


1 

II 

O 

o 

Q 

4 d | 


5 . 

p = 00, 

p ■■ 

= 00 






6 . 

p = 1, 

p = 

= 3 , p 

= 1 





7 . 

p = 1, 

p = 

:V 3 






8 . 

p = 1 








9 . 

(a) p = 

00 

(b) 

P = 

00 

(c) p — 00 

(d) p 

= oo (e) p = 


(f) P = 

V2 

(g) 

P = 

: OO 

(h) p = 1 

0) P = 

= 1 (j) P = 2 


(k) p = 

: V 3 

(1) 

P = 

1 

(m) p = o o 

(n) p 

= 00 

10. 

(a) yi(x) = 

!-£ 

2! 

K 2 - 

(2 2 

— a 2 )a 2 4 (4 2 - 

4! 

- a 2 ) ( 2 2 
6! 

— a 2 )a 2 , 

x 6 • • • 


[(2m - 2) 2 - a 2 ] • • • (2 2 - a 2 )a 2 


(2m)! 


y 2 (x) = x + 


1-cx 2 


3! 


-x J + 


(3 2 - a 2 )(l - a 2 ) 


[(2m - If - a 2 ] ■ 


5! 

• (1 - a 2 ) 


x D + ■ 


x 2m+1 + ■ 


(2m + 1 )! 

(b) y\(x) or y 2 (x) terminates with x n as a = n is even or odd 

(c) n — 0, y = 1; n = 1, y = x; n = 2, y = 1 — 2x 2 ; n = 3, y = x — |x 3 

11 . yi(x) = 1 - ^x 3 + ^x 5 + ^x 6 4-, y 2 (x) —x - ^x 4 + j^x 6 + ^x 7 4-, 

p = 00 

12. yi(x) = 1 - ^x 3 + ^x 4 - ^x 5 + • • •, y 2 (x) = x - ^x 4 + ^x 5 - ^x 6 + • • •, 

p — 00 
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13. yi(x) — 1 ± x 2 ± ^x 4 ± ^x 6 ± • • •, yz(x) — x ± ^x 3 ± ^x 5 ± ^x 7 ± • • •, 
p = nil 

14. yi(x) = 1 + \x 3 + ^x 4 - jigX 6 H-, y 2 (x) = x - \x 3 + ^x 4 + ^x 5 + • • •, 

P = 1 

15. Cannot specify arbitrary initial conditions at x = 0; hence x = 0 is a singular point. 


16. y = 1 ± x ± — H - 1—-4 - = €? 

2! n! 

+ ••• + 


„ X 2 X 4 x u 

17. y = l + y + ^4 + 2^6 

18. y = 1 + x + ix 2 + ix 3 H- 

19. y = 1 +x+x 2 4 - hx" 4 - = 

20. y = fto(l+^+x7 + **'H—7 + • 

V 2! ft! 


2" • ft! 




1 


x 3 x 4 

+ 21 3! + 4! + ' 


x" 

■ H-- ± • • 

ft! 




= a 0 e x ±2(C — 1—x— — ) = ce x — 2 — 2x — x 2 


/. x 2 x 4 x 6 
Ly = flo(l-y + ^2!-^3j + - 


(-l)"x 2n 
■+ ' . +• 


2 "ft! 


/ x 2 x 3 

+ b + y-y 


x 4 x 5 

2 • 4 + 3.5 + ’ ’ 


2 n ( X 2 X 3 X 4 X 5 \ 

23. 1, 1 - 3x 2 , 1 - 10x 2 ± f x 4 ; x, x - |x 3 , x - ^x 3 ± fx 5 

24. (a) 1, x, (3x 2 - l)/2, (5x 3 - 3x)/2, (35x 4 - 30x 2 ± 3)/8, (63x 5 - 70x 3 ± 15x)/8 
(c) P u 0; P 2 , ±0.57735; P 3 , 0, ±0.77460; P 4 , ±0.33998, ±0.86114; 

P 5 , 0, ±0.53847, ±0.90618 


Section 5.4, page 280 

1. y = C\X~ X ± C 2 X -2 2 . y — c i|x ± 1| _1/2 ± C 2 |x ± 1| _3/2 

3. y = c\x 2 ± c 2 x 2 In |x| 4. y = c\x~ l cos(2 In |x|) ± c 2 x _1 sin(2 In |x|) 

5. y = C\X ± C 2 xln |x| 6. y — ci(x — l) -3 ± C 2 (x — l) -4 

7. y = d|x| ( - 5+v ^/ 2 ± c 2 |x |(- 5 -^/2 

8. y = ci |x| 3/2 cos(|V31n |x|) ± C 2 |x| 3/2 sin(|V31n |x|) 

9. y = C 1 X 3 ± c 2 x 3 In |x| 

y — c i(x — 2) -2 cos(21n |x — 2|) ± C 2 (x — 2) -2 sin(21n |x — 2|) 

1] y = ci|x| _1/2 cos(i\/l51n |x|) ± c 2 |x| —1/2 sin^VlSln |x|) 

12. y — C\X ± C 2 X 4 

13. y — 2x 3/2 - x _1 

y — 2x _1/2 cos (2 lnx) — x _1/2 sin (2 lnx) 

16. y — x _1 cos(2lnx) 

18. x = 0, regular; x = 1, irregular 
20 . x = 0, irregular; x = ±1, regular 
22 . x = 0, regular 

24. x = 0, —1, regular; x = 1, irregular 
26. x = 0, 3, regular 
28. x = 0, regular 
30. x = 0, regular 
32. x = 0, ±ft7r, regular 
34. x = 0, irregular; x = ±ft7r, regular 
36. p > 0 


15. y = 2x 2 — lx 2 In |x| 

17. x = 0, regular 

x = 0, irregular; x = 1 , regular 
21 . x = 1 , regular; x = — 1 , irregular 
23. x = —3, regular 
25. x = 1, regular; x = —2, irregular 
27. x = 1, —2, regular 
29. x = 0, irregular 
31 x = 0, regular 
33. x = 0, ±ft7r, regular 
35. a < 1 
37. y = 2 
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38. a > 1 

39. (a) a < 1 and ft > 0 (b) a < 1 and ft > 0, or a = 1 and ft > 0 

(c) a > 1 and ft > 0 (d) a > 1 and ft > 0, or a = 1 and > 0 

(e) a = 1 and /3 > 0 


/ x x 
V 2 • 5 2 • 4 • 5 • 9 "7 


41. y = a 0 (^l-2T5 + 2 
45. Regular singular point 
47. Irregular singular point 
49. Irregular singular point 


44. Irregular singular point 

46. Regular singular point 
48. Irregular singular point 


Section 5.5, page 286 

1. (b) r(2r — 1) = 0; a n = — 


tin— 2 


(n + r)[2(n + r) — 1] 


; n = 1 r 2 = 0 


(c) y,(x) = x 1 ' 2 

+ 


1 2 • 5 + 2 • 4 • 5 • 9 2 • 4 • 6 • 5 • 9 • 13 

(—l)"x 2 " 1 


2"m!5 • 9 • 13 • • • (4« + 1) 


(d) y 2 (x) = 1 - —- + 

+ 


2-3 2-4-3-7 2•4•6•3•7•11 

(-l)"* 2 ” 




2. (b) r 2 - 1=0; a n = 
(c) V, (x) = x l/3 


2"m!3 • 7 • 11 • • • (4m - 1) 

@n —2 


(n + r) 2 — i ’ 


„ _ 1 „ _ l 
r l — 3 ’ r 2 — 3 


1 1 
+ 1 ) \ 2 / + 2!11 4 - 1-112 4 - ll V 2 / + ” 


l!(l+f) 


(- D " 


3' v 1 3' 

v 2m 


m!(l+i)(2+!)...(«+i) 


IT© 


(d) y 2 W = * 


- r-V3 


1 /x\ 2 1 /x\ 4 

1!(1 - |) V2 / + 2!(1 - |)(2 — |) V2 / 

(-l) m /X\2m 




K© 


m!( 1- 1)(2 — i)---(m- 1) 


Hint: Let n = 2m in the recurrence relation, m = 1,2,3,_ 

3. (b) r(r — 1) = 0; a n = ~-— ; n = 1, r 2 = 0 

(m + r)(n + r - 1) 

„ x x 2 (-1)" „ 

1-1-1- • • • 4----- x 4- • 

1!2! 2!3! n!(n + l)! 

4. (b) r 2 = 0; a n = ; r x = r 2 = 0 


(c) y x (x) =x 


(n + r) 2 ’ 


(C) yi (x) = l+ ~^ + +•••+ ^2 +•■• 

5. (b) r(3r — 1) = 0; a„ =- /"i = 1, r 2 = 0 


(m + r)[3(M + r) - 1] 


(c) y, (x) = x 1/3 


1 / x 2 \ 1 /x 2 \ 

V 2 ) + 2!7-13 V 2 / 


1!7 V 2 / 217-13 


©V- 


(- 1 )" 


m!7 • 13 • • • (6m + 1) \ 2 


+ 
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4V + - + - 


(-ir 


ml 5 • 11 • • • (6m — 1) \ 2 

Hint: Let n = 2m in the recurrence relation, m = 1,2,3,_ 

-2_9_ n . - ^n —1 -. ri = ^2, r 2 = —V2 

v-2 


+■ 


6. (b) r 2 — 2 = 0; a n = — 


(n + r ) 2 — 2 ’ 

(c) y x {x) = r*[l- 


1(1 + 2-jT) 2!(1 + 2V2)(2 + 2V2) 

(-D" 


nl{l 4- 2a/2)(2 4- 2 a/ 2) • • • (ft 4~ 2 a/2) 


x n + ■ 


(d) y 2 (x) = * ^1 - 


1(1-2V2) 2!(1 - 2V2)(2 - 2V2) 

(- 1 )" 




x" + • 


n!(l - 2 a/2)(2 - 2a/2) •••(«- 2V2) 

7. (b) r 2 = 0; (« 4- r)a„ = a n _i; ri = r 2 = 0 

(c) yi(x) = 1 + x + ^ + • • • + — + • • • = e* 

2! 3! n\ 

8. (b) 2 r 2 + r — 1 = 0; (2n + 2r — l)(n + r + l)a n + 2a„_ 2 = 0; 

H = |, r 2 = -1 


(c) yi(x) = x 1 / 2 ^1 - y + ^ 


2!7 • 11 


- + 


(-l) m x 2 


(d) y 2 (x) — x 1 ( ! — x 2 + —-+ 


m!7 • 11 • • • (4m + 3) 


ml 5 • 9 • • (4m — 3) 

9. (b) r 2 — 4r + 3 = 0; (n 4- r — 3)(n + r — l)a„ — (n + r — 2)a n _i =0; ri = 3, r 2 = 1 


= x 3 ^1 


. . 2 x 2 2x n 

(C) yi (x)=x3(l+-X+-+...+ ^ T ^ + . 


10. (b) r 2 - r + 1 = 0; (n + r - \) 2 a n + a „- 2 = 0; r x = r 2 = 1/2 

(c) y \ (x) = x 1 / 2 |4 

11 . (a) r 2 = 0; fi = 0, r 2 = 0 


„ „ 2 x 4 (—l) m x 2m 

1-1-• ■ • + -— -h ■ 

22 ^ 2 2 4 2 2 2m (w!) 2 


... t a 1 , «(« + !). .. «(a + l)[l -2-a(a + l)] 2 

(b) yi(x) = 1 + - „ (x - 1)--(* - 1) + ■ 


+(—!)' 
+ • 


2 • l 2 ' (2 • 1 2 )(2 • 2 2 ) 

B+1 a(a + 1)[1 • 2 - a(a + !)]••• [n(n - 1) — a(a + 1)] 


2 " («!) 2 


(x - 1)" 


12 . (a) ^ = 1, r 2 = 0 at both x = ±1 
(b) >>i(x) = |x-l| 1/2 


X 


1 + (-!)"(! + 2«) • • • (2w - 1 + 2a:)(1 - 2«) ■ • • (2w - 1 - 2 a) ^ ^ 


n =1 

y 2 (*) = l 


2” (2 n + 1)! 


| ^ (-!)"«(! + or) • • • (w - 1 + «)(-«)(! - or) •••(«- 1 - a) ^ 


n=l 

„2 


13. (b) r 2 = 0; r\ — 0, r 2 = 0; a n = 


nil • 3 • 5 • • • (2 n — 1) 

(n — 1 — X)« n i 
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(c) yi(x) = i + ^L x+ 

' ’ m ’ + (l!) 2 + (2!) 2 + + (n!) 2 


For X = n, the coefficients of all terms past x n are zero. 

16. (e) [(n — l) 2 — 1 ]b n = —b n _ 2 , and it is impossible to determine b 2 . 


Section 5.6, page 294 


1. (a) x = 0; 

2. (a) x = 0; 

3. (a) x = 0; 
(a) x = 1; 

4. None 

5. (a) x = 0; 

6. (a) x = 0; 
(a) x = -2; 

7. (a) x = 0; 

8. (a) x = -1; 

9. (a) x = 1; 

10. (a) x = -2; 

11. (a) x = 2; 
(a) x = -2; 

12. (a) x = 0; 


(b) r(r — 1) = 0; r x — 1, r 2 = 0 
(b) r 2 — 3r + 2 = 0; r x = 2, r 2 = 1 
(b) r(r — 1) = 0; r x = 1, r 2 = 0 

(b) r{r + 5) = 0; = 0, r 2 = -5 

(b) r 2 + 2r — 2 = 0; r x = -1 + V3 = 0.732, r 2 = -1 - V3 = -2.73 
(b)r(r-|) = 0; r 1 = f, r 2 = 0 
(b) r(r- |) = 0; r x = f, r 2 = 0 
(b) r 2 + 1 = 0; ;'i = i, r 2 = —i 

(b) r 2 - Ir + 3 = 0; n = (7 + V37)/2 = 6.54, r 2 = (7 - V37)/2 = 0.459 
(b) r 2 + r = 0; n = 0, r 2 = -1 
(b) r 2 - (5/4)r = 0; n = 5/4, r 2 = 0 
(b) r 2 -2r = 0; n = 2, r 2 = 0 
(b) r 2 - 2r = 0; r, =2, r 2 = 0 
(b) r 2 — (5/3 )r = 0; r t — 5/3, r 2 = 0 

(b) r 2 - (r/3) -1 = 0; r, = (1 4- V37)/6 = 1.18, 


3.2 _ iL v 3 i . 
4 a 108 a ' 


(a) x = -3; 

r 2 = ( 1 — V37)/6 = -0.847 

13. (b) n = 0, r 2 = 0 

(c) yi(x) = 1 + x + ^x 2 + ^x 3 4-, y 2 (x) = y x (x) lnx - 2x 

14. (b) n = 1, r 2 = 0 

(c) _yi(x) = x — 4x 2 + ^x 3 — ^x' 4 + • • •, y 2 (x) = —6y x (x) lnx + 1 — 33x 2 + ^x 3 + 

15. (b) n = 1, r 2 = 0 

(c) y x (x) = x + |x 2 + |x 3 + |x 4 4-, y 2 (x) = 3y x (x) lnx + 1 - ^-x 2 - ^x 3 4- 

16. (b) n = 1, r 2 = 0 


(c) yi(x) = x- ^x 2 + ^ 3 


-V-4 J_ yA _ 1 

1AA *' v ‘ 


144 

y 2 (x) = —yi(x)lnx + 1 - fx 2 + ^x 3 - ^x 4 + • 


_L r ^ _L . 
90 x ^ 


17. (b) r x = 1, r 2 = -1 

(c) y\ (x) =x- ^X 3 + ^qX 5 + ---, y 2 (x) = -lyi(x)lnx + x“ 1 - - 1 *- 3 

18. (b) r 1 = i,r 2 = 0 

(c) y, (x) = (x - 1) 1/2 [1 - |(x - 1) + l(x - l) 2 + • • •], (d) p = 1 

19. (c) Hint: (n — l)(n — 2) 4- (1 + a + /3)(>z — 1) 4- a/3 = (n — 1 4- a)(n — 1 + ft) 

(d) Hint: (n - y)(n -l-y) + (l + a + P)(n - y) + aft = (n - y + a)(n - y + ft) 


Section 5.7, page 305 


1. yi(x) = J2 


n =0 


(-l) n X n t 1 


3-E 


Hn+Hn.t 


2 —' «!(« — 1)! 

n=l 

, , , 1 A (-l)"x" . . ... 2 ^ {—l) n H n 

2. yi(x) = - 2_, 2 . 3'2(x)=3'i(x)lnx--^ 


(-l)"x n 


x^ (n!) 2 


x ^ (^i!) 2 


3. yi(x) = ^ 


C-l)"2" 
(n!) 2 


, yz(x) = y , (x) lnx - 2 ^ 


(- 1)"2 n H n n 

-r 

(n!) 2 
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Answers to Problems 


\ °° (—l) n 1 

4. yi (x) = -T — — y 2 (x) = -yiWlnx + 3 


x ^ n\(n + 1 )! 


1 _£ ; g . + ^ 1 


5 yi (x) = x 3/2 


y 2 (x) = x 3/2 


1 + E 


(-D” 


j w!(l + |)(2 + §)••• (m + |) 


■ + £: 


(- 1 )" 


(ir 

(i ) 2 


Hint: Let n = 2m in the recurrence relation, m = 1,2,3,_ 

3 

'2 

CHAPTER 6 Section 6.1, page 315 


For r — — |, 0 i = 0 and a 3 is arbitrary. 


1. Piecewise continuous 2. Neither 

3. Continuous 4. Piecewise continuous 

5. (a) F{s) — 1/s 2 , s > 0 (b) F(s) = 2/s 3 , s > 0 (c) F(s) = nl/s n+1 , 

6. F(s) = s/is 2 Fa 2 ), s > 0 


5 > 0 


7. F(s) = 

8 . F(s) = 
10. F(s) = 


-b 2 ’ 
b 

s 2 — b 2 ' 
b 


(s - a ) 2 - b 2 

12. F(s) = „ S , n , s > 0 


s > \b\ 

s > \b\ 

s — a > \b\ 


9. F(s) = 


(5 — a ) 2 — b 2 

11. F(s) = E s > 0 


, s — a > \b\ 


14. F(s) = 


s 2 + b 2 ’ 
s — a 


13. F(s) = 


s 2 + b 2 ’ 
b 


is — a ) 2 + 

2 as 

16. F(s) = —-—, 5 > 0 


s > a 


(s - a ) 2 + b 2 ’ 

1 

15. F(s) = - -—, s > a 


18. F(s) = 


(, s 2 + a 2 ) 2 ’ 
n\ 


(5 - a ) n+1 ’ 

Z7 / x 2a ( 3s2 + I, 

20. FCs) = —^5 > \a\ 


17. F(s) = 


19. F(s) = 


22 . F(s) = 
24. F(s) = 


is 2 — a 2 ) 3 
1 — (s + l)e - 

1 — 2 e s + e 


21. F(s) = 


23. F(s) = 


(5 — a ) 2 ’ 
s 2 + a 2 

(5 — a ) 2 (s + a ) 2 
2a(3s 2 — a 2 ) 

(. s 2 + a 2 ) 3 
1 - e 


, s > \a\ 
s> 0 


s 

1 — e~ s 


26. Converges 
28. Converges 

30. (d) T(3/2) = V^/2; F(ll/2) = 945^/32 


25. Converges 
27. Diverges 


Section 6.2, page 324 

1. f(t) = | sin2t 
3. /(f) = \tf - |e -4 ' 

5. /(t) = 2 e~ l cos 2 t 
7. f{t) = 2e l cos t + 3e { sin t 
9. f{t) = — 2 e~ 2t cos t + 5e~ 2t sin t 
11. y = | (e 3r H- 4e“ 2 0 
13. y = e l sin t 

15. y = 2e l cos y/31 — {2/V3)e t sin V31 
17. y = te t — t 2 e f + | tV 
19. y = cos V2 1 


2 . /(0 = 2tV 
4. /(t) = ^e 3t + |e _2? 

6. /(t) = 2cosh2t — | sinh2t 
8. f{t) = 3 — 2 sin 2t + 5 cos 2 1 
10. fit) = 2e _t cos 3 1 - \e~ f sin 3 1 
12. y = 2 e~ l - <r 2r 
14. y = e 2t — te 2t 
16. y = 2e~ l cos 2 1+\ e~ l sin 2 1 
18. y = cosh t 

20. y = ico 2 — 4) _1 Hco 2 — 5) cos cot + cos 2 1 ] 
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21 • y = \ (cos t - 2 sin t + Ae* cos t - 2e x sin t) 
23. y = 2e~ l + te + 2t 1 e~ t 

1 e-*(s + 1 ) 


25. Y(s) = 


27. Y(s) = 


S 2 (* 2 + 1 ) s 2 (s 2 + 1 ) 

1 — 2e~ s + e -2 * 


s 2 (s 2 + 1) 

30. F(s) = l/(j - a) 2 
32. F(s) = rc!/s n+1 

34. F(s) = 26(s - a)/[(s - a ) 2 + b 2 ] 2 

37. (a) Y' + s 2 Y = s (b) s 2 Y" + 2sY' - 


22 . y = ±(e { — e* cos t + le l sin t) 


24. Y(s) = 
26. Y(s) = 


+ 


l-e~ 


s 2 + 4 s(s 2 + 4) 
1 -<r J 


S 2 (S 2 + 4) 


31. F(s) = 2b(3s 2 - b 2 )/(s 2 + b 2 ) 3 
33. F(s) = n\/(s - a) n+1 
35. F(s) = [(5 - a) 2 - b 2 ]/[(s - a) 2 + b 2 ] 2 
[,s 2 + a (a + 1)]Y = —1 


Section 6.3, page 333 


7. 

8 . 

9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

17. 

19. 

21 . 

23. 

26. 

28. 

30. 

32. 

33. 


35. 

37. 

39. 


40. 


(b) fit) = —2 u 3 (t) + 4 u 5 (t) - u^t) 

(b) fit) = 1 — 2wi(t) + 2w 2 (0 — 2 m 3 (0 + M4(t) 

(b) /CO = 1 + M2«[e- (, - 2) - 1] 

(b) /(0 = f 2 + «2(0(1-i 2 ) 

(b) /(0 = t - ui(t) - u 2 (t ) - m 3 (00 - 2) 

(b) f(t) = t + 112 ( 0(2 - 0 + «s(*)(5 - 0 - « 7 ( 0(7 - 0 

F(.v) = 2 e~ s /s 3 
F(s) = e“V + 2 )/s 3 


fW = —5-r-(l +TO) 

.V- .V- 

F(s) = s“ 2 [(l - s)e~ 2s - (1 + s)e _3s ] 
f(t) = t 3 e 2 ‘ 

fit) = 2 u 2 it)e‘~ 2 cos it — 2) 
fit) — uiit)e 2if ~ v> cosh (7 — 1) 
fit) = 2(20” 

/(<) = \e’ l3 ie 2 ’ 13 - 1) 

F(s) = s _1 (l — e~ s ), s > 0 

Fis) = -[1 - e“ s + • • • + e“ 2 " s - e- (2n+1)J ] = 


16. Fis) = -ie~ s + 2e~ 3s - 6e~ 4s ) 
s 

18. Fis) = (1 - e~ s )/s 2 

20. fit) = \u 2 it)[e‘- 2 - e- 2 < ( - 2 >] 

22. fit) = m 2 (0 sinh 2 (t — 2 ) 

24. /(0 = Mi(t) + U 2 it) — 1 / 3(0 — M4(0 
27. /(0 = |e _ * /2 cosf 
29. fit) = 


31 Fis) = s X (1 — e 

\ _ e ~(2n+2)s 


+ c 2 * — e 3s ), 5 > 0 


1 00 

f(j) = - y (-i) n ^ = 

V z -' 


s(l + e _s ) 


Vs 

l + e~ 


s > 0 


cm) = 
cm) = 


Vs 

l + e~ 
l-(l+s)e- 


s > 0 


s 2 (l — e~ s ) 

(a) £{fit)} = s~\l-e~ s ), 
(c) C{hit)) = i“ 2 (l - e“ s ) 2 , 


(b) C{pit)} = 


1 — e 


s 2 (l +e~ s ) ’ 


s > 0 

s > 0 
s > 0 

s > 0 


36. C\fit)} = 
38. C\f(t)} = 


s> 0 


l-e~ 


s(l + e~ s ) 

1 + e~ ns 


s > 0 


(l+s 2 )(l 
(b) C{g(f)} = s~ 2 i 1 - e- s ), 


- e~ ns ) ’ 
s > 0 


s > 0 


Section 6.4, page 340 

1 . (a) v = 1 — cos t + sin t — u 2lt it)i\ + cos t) 

2 . (a) y = e~ l sin t + |w w (t)[ 1 + cos t + e _(r_7r) sin t ] 

— | W 2 tt( 0[1 — g _ ^ _27r ) cos ^ — e~^~ 27t) sin t] 

3. (a) y = \[l - w 2 7 t( 0 ]( 2 sin£ — sin20 

4. (a) |(2 sin t — sin20 — \u n it)i2smt + sin20 

5. (a) y = 1 + |e- 2? - - uM\ + \e~ 2 ^ - e-^ 10 >] 
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Answers to Problems 


6. (a) y = e~ f - e~ 2t + u 2 {t)[\ - e~ (t ~ 2) + \e~ 2(f ~ 2) ] 

7. (a) y = cos t + u 3 jr (t)[ 1 — cos(7 — 3it)] 

8. (a) y = h{t) — u n/ 2 it)hit — it/2), hit) = ^ (—4 + 5^ + 4e ~ t/2 cos t — 3e ~ t/2 sin t) 

9. (a) y = \ sint + \t — \u 6 (t)[t — 6 — sin(7 - 6)] 

10. (a) y = hit) + u n (t)h(t — it), hit) — ^ [-4 cos t + sin t + Ae ~ t/2 cos t + e -r/2 sin t ] 

11. (a) y = m„( 0[ j | cos(2f - 2 jt)] - w 3jr (0[ J - \ cos(2 1 - 61 r)] 

12. (a) = ui(t)h(t — 1) — u 2 (t)h(t — 2), /z(0 = — 1 + (cos£ + cosh 0/2 

13. (a) y = h(t) — u n (t)h(t — it), h(t) = (3 — 4 cos £ + cos 2t )/12 

14. /« = [u t ,m - to) - u t0+k m -t 0 - k)Kh/k) 

15. g{t) = [u t 0 (t)(t - to) - 2 u t 0 +k (t)(t -to-k) + u t 0 + 2 k (t)(t -to- 2 k)](h/k) 

16. (b) u(t) = 4 ku 3 / 2 it)h(t — |) — 4kus/ 2 (t)hit — |), 

h(t) = \ - (>/7/84) sin(3 V7 t/S) - ^e ^ 8 cos(3^7 f/8) 

(d) A: = 2.51 (e) r = 25.6773 

17. (a) k = 5 (b) y = [usit)hit — 5) — us +k it)hit — 5 — k)]/k , /i(7) = | sin2£ 

18. (b) f k it) = [^(0 - 

_y = [w 4 _A:(0^(^ — 4 + A;) — w 4+ ^(0^(^ - 4 - k)\/2k, 

hit) = \ - ^e ~ t/6 cos(Vl43 1/6) - iVl43/512) e ^ 6 siniVl43t/6) 

19. (b) y = 1 — cos t + 2 J2 (— l) k u kjT it)[3 — cos it — kit)] 

k=t 

21 (b) v = 1 — cos t + J 2 (—l) ku knit)[3 — cos it — kit)] 
k =i 

23. (a) y = 1 — cos t + 2 T.i-l) k u nk/A it)[l - cos (t - Ilk/A)] 

k= 1 

Section 6.5, page 348 

1. (a) cos t + sin t + u n it)e~ {t ~ n) sin(7 — it) 

2. (a) = \Unit ) sin 2(7 — it) — \u 2 jr it) sin2 it — 2it) 

3. (a) = — \e~ 2t + \e~ l + usit)[—e~ 2{t ~ 5) + e -(?-5) ] + w 10 (7)[| + ie _2(r_10) — g-(f-i°)] 

4. (a) = cosh(7) — 20i/3(7) sinh it — 3) 

5. (a) \ sin t — | cos t + \e~ l cos y /21 + (1/V2) u 3 n it)e~^~ 37r) sin V2(7 — 37r) 

6. (a) y — \ cos 2 1 + \u All {t) sin 2(7 — Ait) 

7. (a) y = sin t + u 2 n it) sin (7 — 2it) 

8. (a) = Ux /4 it) sin 2 it — it/A) 

9. (a) y = u n/ 2 it)[l - cos (t - it/2)] + 3 u 3 jT/ 2 it) sin(7 - 3it/2) - u 2 jT it)[l - cos (t - 2it)] 

10. (a) y = (1/V31) u„ / 6 it) exp [~\it - it/ 6 )] sin(V3l/4)(7 - it/ 6 ) 

(a) | cos t + | sin t — cos t — \e~ l sin t + w^/ 2 ( 0 ^ _(r_7r/2) sin it — it/ 2 ) 

12. (a) = Wi(0[sinh(Y — 1) — sin^ — l)]/2 

13. (a) —e~ T/A &it -5 - T), T = 8tt/V15 

14. (a) y = (4/Vl5) Wi( 0^ _( ' _1)/4 sin(Vi5/4)(r - 1) (b) h = 2.3613, yi = 0.71153 

(c) y = (8V7/21) wi(0e- ( '“ 1)/8 sin(3\/7/8) it - 1); 0 = 2.4569, = 0.83351 

(d) 4 = 1 + it/2 = 2.5708, yi = 1 

15. (a) = 2.8108 (b) k x = 2.3995 (c) k x = 2 

16. (a) (pit , /:) = [w 4 _£(0^(/ — 4 + &) — w 4+ ^(0^(^ — 4 — k)]/2k, hit) = 1 — cos £ 

(b) 0o (0 = w 4 (0 sin(/ L — 4) (c) Yes 

20 

17. (b) y = 5Z sin(? - kit) 

k= 1 
20 

18. (b) y = XX—l)* +1 Wfot(0 sin(f — kn) 

k= 1 

20 20 

19. (b) y = X Mfcr/zW sin ( f “ kn/2) 20. (b) y = Xf-O^V^W sin ( f - kn/2) 

k= 1 fc=l 
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15 40 

21 (b) y = Y sin[f - (2k - 1 )tt] 22. (b) y = Y (-1)* +1 mii*/ 4(0 sin (t - llk/4) 


k =1 


k =1 


23. (b) y = Y(~V k+lu kAt)e-«- k ^ 20 s in[>/399(f - for)/20] 

V fc=l 

24. < b > ^ = Jb ^ w (2 ^i )7r (0^ [? - (2/: - 1)7r]/20 sin{V^99[^ - (2A - 1)tt]/20} 

k =1 


Section 6.6, page 354 


3. 

4. 

5. 

6 . 

8 . 

10 . 

12 . 

13. 

15. 

16. 

17. 

18. 

19. 

20 . 

21 . 

23. 

24. 

25. 

26. 

27. 

28. 


sin t * sin t = \ (sin t — t cos t ) is negative when t = 2n , for example. 
F(s ) = 2/s 2 (s 2 + 4) 

F(s) - l/(s + l)(s 2 + 1) 

F(s) = l/s 2 (s - 1) 7. F(s) = s/(s 2 + l) 2 

f(t) = | / (7 — t ) 3 sin rzir 
Jo 

z)e~ {t ~ r) sin 2 r zir 


9. /(0 = 


/CO = 


(C) 


\fo- 


11 . /(*) = 


(1 — m)" zi/i = 


T(m + 1) T(n + 1) 
T(m + n + 2) 


■ O/ T -L 

/V«-> 

Jo t 

/ sin(t — 
Jo 


cos2z dz 


r)g(r) dr 




f 1 u” 

Jo 

lip p 

y = — sin ait H-/ sinai(t — r)g(r) zir 14. y = / 

CO ^ CO J 0 Jo 

y = | f sin2(t — r)g(r) dr 

Q t 

y = e~ t/2 cos t - \e~ t!2 sin/ 1 + f e _(r_T)/2 sin(t — r)[l — u n ( r)] zir 
z io 

_y = 2c _2? + te _2r + f (t — z)e~ 2 ^~ r) g(z) dz 

Jo 


sin(t — z) sin (xt zir 


y — 2e 1 — e 2t + 


y = 


\s> 


[ [e- (t ~ T) 
Jo 


[sinh(t — z) — sin(t — r)]g(r) dz 


y = | cos t cos 2 1+ l I [2 sin (t — z) — sin 2(t — r)]g(r) dz 
Jo 


$(*) = 


F(s) 


22. (a) 0(0 = i (4 sin 27 — 2 sin 0 


1+K(s) ” w ^ 3 

(a) 0(0 = cos t (b) 0"(O + 0(0 = 0 , 0 ( 0 ) = 1 , 0 '(O) = 0 

(a) 0(0 = cosh(0 (b) 0"(O - 0(0 = 0 , 0 ( 0 ) = 1, 0 '(O) = 0 

(a) 0(0 = (1 - 2f + 7 2 )^ 

(b) 0"(O + 20'(0 + 0(0 = 2<r‘, 0 ( 0 ) = 1 , 0 '(O) = -3 

(a) 0(0 = — |^ /2 cos(V3t/2) + y^e t/2 sin(V3t/2) 

(b) 0 "'(o + 0(0 = o, 0 ( 0 ) = 0 , 0 '(O) = 0 , 0 "(O) = 1 

(a) 0(0 = cos t 

(b) 0 (4) (O - 0(0 = 0, 0 ( 0 ) = 1, 0 '(O) - 0 , 0 "(O) = -1, 0 "'(O) = 0 

(a) 0(0 = 1 - ^£r r/2 sin(V3t/2) 

(b) 0"'(O + 0"(O + 0'(O = 0, 0 ( 0 ) = 1 , 0 '(O) = -1, 0 "(O) = 1 


CHAPTER 7 Section 7.1, page 363 


1. x' x = x 2 , ^2 = — 2xi — 0.5x 2 2. x[ = x 2 , x 2 = — 2jci — 0.5x 2 + 3 sin 7 

3. x' x = x 2 , x ' 2 — —(1 — 0.25t _2 )xi — 7 _1 x 2 4. = x 2 , x 2 = x 3 , x 3 = x 4 , x 4 = x 4 

5. x\ = x 2 , ^2 = -4xi - 0.25 x 2 + 2 cos 37, xi(0) = 1, x 2 (0) = —2 






616 


Answers to Problems 


6. x[ = X 2 , x' 2 = —q{t)x 1 — p(t)x 2 + g(t) m , Jti(O) = Uo , X2(0) = u' 0 

7. (a) jci = cie~ f + c 2 e~ 3t , x 2 = c\e~ l — c 2 e~ 3t 

(b) ci =5/2, C 2 = —1/2 in solution in (a) 

(c) Graph approaches origin in the first quadrant tangent to the line x\ = x 2 . 

8. (a) x'[ — x[ — 2x 1 = 0 (b) x\ — yC 2r — x 2 = y e 2t — |c _r 

(c) Graph is asymptotic to the line x\ = 2x2 in the first quadrant. 

9. (a) 2x’{ - 5x\ + 2x\ = 0 (b) x\ = - |c r/2 - ^c 2r , x 2 = |c r/2 - |c 2r 

(c) Graph is asymptotic to the line x\ — X 2 in the third quadrant. 

10. (a) x’[ + 3x[ + 2jci = 0 (b) x 3 = —le~ f + 6e~ 2t , X 2 = —le~ f + 9e~ 2t 

(c) Graph approaches the origin in the third quadrant tangent to the line x\ = x 2 . 

11. (a) x" + Ax\ = 0 (b) jci = 3 cos 2t + 4 sin 21 , X 2 = —3 sin 2^ + 4 cos 21 

(c) Graph is a circle, center at origin, radius 5, traversed clockwise. 

12. (a) x![ + x[ + 4.25xi = 0 

(b) X\ = —2e~ t/2 cos 21 + 2e~ t/2 sin 21 , X 2 = 2e~ t/2 cos 21 + 2e~ t/2 sin 21 

(c) Graph is a clockwise spiral, approaching the origin. 

13. LRC1" + LI r + RI = 0 

18. y[ =y 3 , y 2 =y 4 , miy' 3 = -(k x + k 2 )yi + k 2 y 2 + G(0, 
m 2 y 4 = k 2 yi - (k 2 + k 3 )y 2 + F 2 (t) 

22. (a) <21 = § - 55 G 1 + IG 2 , Qi(0) = 25, & = 3 + igi - ig 2 , g 2 (0) = 15 

(b) Of = 42, <2f = 36 

(c) xl = -^Xi + ^x 2 , JCi(O) = —17, 4 = 55*1 “ 5 * 2 , X2(0) = -21 

23. (a) <21 = 3 9l - ig! + jig g 2 , gi(0) = g° 

Q1 = c h + ^Q, - ^g 2 , Q 2 (0) = g« 

(b) gf = 6(9 9l + 92 ), Qf = 20(3^! + 2 <? 2 ) (c) No (d) f < gf/Qf < f 


Section 7.2, page 376 



3 (a) 


/-2 

1 

2 \ 

n 

3 

~ 2 \ 

1 

0 

-i 

(b) 2 

-1 

i 

V 2 

-3 

i 

\3 

-1 

0/ 


(c),(d) 



1 — i 
-2 - 3 i 


(c) 


3 + 2/ 
1 — i 


2 + / \ 
-2-3 i) 
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6. (a) 


(c) 


11 


( 5 

0 


20 

17 

(b) 2 

7 

4 

3 

-12/ 

l-l 

1 

4/ 


-8 

15 

-1 


8 . (a) 4 i (b) 12 - Si (c) 2 + 2 i 


10 . 


11 . 


_± 

n 

j_ 

n 

j_ 

12 

1 

4 


/ 2c 2r — 2 + 3c 3r 
(b) 4c 2r - 1 - 3c 3r 
\-2e 2t - 3 + 6c 3r 


(d) 16 



( 1 


-3 

2 \ 



5 

12> 1 

- 3 


3 

— 1 I 


13. 

1 

3 


l 2 


-1 

0/ 



\~l 








(\ 

14. Singular 




15. 

0 








\0 


h 


3 

10 

1 \ 
10 




16. 

2 

10 


4 

10 

2 

10 


17. Singular 


\~ro 


1 

3 

10/ 






10 





l 

1 

0 

i \ 



6 

18. 

l 

0 

1 

l 


19. 

5 

l 

1 

1 

l 


0 


o 

1 

0 

i / 



-2 



7c' 

5c~‘ 

10c 2 '\ 



21. (a) 

— c' 

le~ l 


2 e 2 ‘ 





8c' 

0 


-e 2 ‘ 




13 

5 

11 

5 

_ 1 
5 

_ 4 
5 


1 + 4c 2? — c r 

2 + 2e- 2r + c ? 
-1 + 6e- 2? - 2c' 


o\ 

i 

3 

V 


3 c 3 ' + 2c' — c 4 '^ 
6c 3 ' _|_ g* _|_ 

-3c 3 '+ 3c'-2c 4 'J 


(c) 


c l 
2c' 
—c' 


I \ 

4 

5 
1 
5 

-s > 


-2c"' 

2c 2 '\ 


1 

2c- 1 

\(e + 1)^ 

-c - ' 


(d) (e - 1) 

2 

c _1 


-3c"' 

4e 2 '/ 


L 1 

3c- 1 

c + 1 j 


Section 7.3, page 388 


1. jti = — 1, X 2 = x 3 = — | 2. No solution 

3. jti = —c, X 2 = c + 1, X 3 = c, where c is arbitrary 

4 . X\ = c, X 2 — — c, x 3 = —c, where c is arbitrary 

5 . x\ = 0, x 2 — 0, x 3 = 0 6 . X\ = ci, x 2 = c 2 , x 3 = c 3 + 2c 2 + 2 

7. Linearly independent 8 . x (1) — 5x (2) + 2x (3) = 0 

9. 2x (1) — 3x (2) + 4x (3) — x (4) = 0 10, Linearly independent 

11. x (1) + x (2) — x (4) = 0 13, 3x (1) ( t ) — 6x (2) ( t ) + x (3) ( t ) = 0 

14. Linearly independent 16, X\ = 2, x (1) = ( \ ]; X 2 = 4, x (2) = ^ 
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17. X t = 1 + 2 i, x m = 


18. X, = -3, x (1) = 




A -2 — 1 — 2/, x (2) = 


-Gi.) 


X 2 = -1, x® = 


19. X, = 0, x« = ' ; X 2 = 2, x< 2 > = 


T) 


20. X, = 2, x (1) = 


(f> 


X 2 = -2, x® = 


(-Vs) 


21. X\ = —1/2, x 


(i) 


GV 


A ,2 = —3/2, x 1 


( 2 ) 


© 


22. A.! = 1, x (1) = f -3 | ; k 2 = 1 + 2/, x® = ( 1 | ; X 3 = l-2i, 


1 ,( 3 ) _ 


23. A.i = 1, x (1) = f 0 | ; A -2 — 2, x (2) = f 1 | ; X 3 = 3, 


,( 3 ) 


24. A.i = 1, x (1) = I — 2 I ; X 2 = 2, x (2) = I 1 I ; X 3 = —1, 


r(3) _ 


25. X\ = —1, x (1) = I — 4 I ; X 2 = —1, x (2) =1 0 I ; X 3 = 8, 


*( 3 ) - 


Section 7.4, page 394 


2. (c) W(t) = cexp J lpu(t)+pzzit)] dt 
6 . (a) W(0 = £ 2 


(b) x« and x (2) are linearly independent at each point except t = 0; they are linearly 
independent on every interval. 

(c) At least one coefficient must be discontinuous at t = 0. 



7. (a) W(t) = t{t — 2)e l 

(b) x« and x (2) are linearly independent at each point except t = 0 and t = 2; they are 
linearly independent on every interval. 

(c) There must be at least one discontinuous coefficient at t = 0 and t = 2. 

/ 0 1 \ 

(d) x' = I 2 — 2 1 t 2 — 2 I x 

\t 2 - 2 t t 2 - 2 t) 


Section 7.5, page 405 

1. (a) x = ci Qj e~‘ + c 2 (/j e 1 ' 

(a) x = d e‘ + c 2 Qj e~‘ 


(a) x = ci e ' + c 2 0^ e 2t 
(a) x = ci e~ 3 ‘ + c 2 Gjj e 2 ‘ 
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5. (a) x = ci I ) e 3t + c 2 


7. (a) x = ci 
9. x = ci 


0 


I 4 J + C2 V 2 


6. (a) x = ci ( ^ ) c r/2 + c 2 I , | c" 


(a) x = ci ( i J + c 2 


0) + «(-i)' 


X = Cl 




11. x = ci I 1 I e 4t + c 2 I — 2 I e* + C3 I 0 I c 1 


12. x = ci I —4 I c r + c 2 I 0 I e 1 + C3 I 1 I c 8i 


13. x = ci I — 5 I c 2t + c 2 I —4 I c 1 + c 3 I 1 I c 2i 


C- + 1 , > 


+ C 2 


14. x = ex —4 \e l + c 2 -1 c 2r + c 3 2 c 3 


15. x = — 


3 (1 


2 \3 


‘ 2,+ K i y 




e~' + - 


1 /I 


2 \5 


17. x = — 2 I e‘ + 2 I 1 I e 2 ‘ 


20. x = ci A t + c 2 A t 1 


18. x = 6 2 e' + 3 -2 \ e~‘ - 1 e 4 


21. x = ci 


( 0 ' ,+c! (!) 


; x = ci I 4 1 +c 2 




23. x = ci I ^ ) f 1 + c 2 


29. (a) jc'j = jc 2 , ^2 — —{c/a)x\ — ( b/a)X 2 


55 /3 


29/1 


30. (a) x = - — ( 0 ) c ?/20 + — ( A c ?/4 


31. (a) x = ci 


8 V 2 > 

'-y/ 2 \ 


(c) T = 74.39 


9 (-2+V2)t/2 


+ c 2 ( v “ 1 e (-2-^/2. ri?2 = (_2 ± V2)/2; node 


(b) x = ci c ( 1+>/2)r + c 2 | 

(c) ri j2 = — 1 dfc of = 1 


32. (a) fyj = ci Q) e 2 ' + c 2 


e 


(-1 -V2)t. 


; r h2 = — 1 ± \/2; saddle point 




Section 7.6, page 417 


cos2r ^ 


sin 2t \ 


1 . (a) x = Ci e‘ ( cos2/ + sin2f j + c 2 c' (_ CQs2f + sin2f j 

. . . t (2 cos 2A t f —2 sin 2t\ 

< a > * = « si„2, +« cos2( 
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3. 


4. 


5. 


6 . 


7. 


8 . 


9. 

10 . 


11 . 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20 . 

21 . 


22 . 

23. 

24. 

25. 


26. 


28. 

29 . 


(a) x = ci 


5 cos 
2 cos t + 


linr) +C2 (- 


5 sint 
cos t + 2 sin t 


(a) x = c\e t/2 
(a) x = cie~ l 


5 cos 1 1 


3(cos 1 1 + sin \t) * + Cl6 


5 2* 
cost 


,t /2 


5 sin |t 
3(— cos §t + sin \ t) 


1 2 cost + sin t 


+ c 2 c 


sint \ 
1 1 + 2 sin t J 

) 


_ / -2 cos 3t \ / -2sin3t 

(a) x c i l cos 3 ^ _|_ 3 s j n 3 ^) Cl 1 sin 3 t — 3 cos 3 t 


/ 2 \ / M 

x = ci -3 I c* + c 2 e l cos2t + c 3 c r 


1 sin 2t > 



x = ci I —2 I e 2t + c 2 e 


■ - 1 


(cos t — 3 sin t\ 

\ cos t — sin t ) 
cos t — 5 sin t \ 
—2 cos t — 3 sin tj 


—V2sinV2 t ^ 
cos \/2t 

- cos V2t - V2 sin V2 1) 


+ c 3 c 


^ V2 cos V2 £ ^ 

sin\/2t 

^V2 cos V2 t - sin V2 1) 


(a) r=-\±i 
(a ) r = a ±i (b) a = 0 
(a) r = (a ± \/a 2 — 20) /2 
(a) r = ±V4 — 5a 


12 . (a) r = i ± i 


(a) r=\± |V3a 


(b) a = -V20, 0, 720 
(b) a = 4/5 
(b) a = 0, 25/12 
(a) r — — 1 ± V — 'Qf (b) a = —1, 0 

(a) r = -i±i749 - 24a (b) a = 2, 49/24 

(a) r = |a - 2 ± 7« 2 + 8a - 24 (b) a = -4 - 27T0, -4 + 2710, 5/2 

(a) r = -1 ± 725 + 8a (b) a = -25/8, -3 
cos(721nf) \ _j / sin(721n0 

V2 sin(V2 In 0/ \—\/2 cos(V21 


x = c 3 t 




In o) 


+ C 2 


5 sin (In t) 


_ f 5 cos (In t) 

K — Cl y2cos(lnt) + sin (In 0 
(a) r = -i ±i, - j 
(a) r = -|±i, £ 

(c) Use ci = 2, c 2 = — | in answer to part (b). 

(d) lim 7(f) = lim V(t) = 0; no 

cost \ / 

V-si 


- cos (In t) + 2 sin (In t) 


/ sin(t/2) \ 
y—4cos(t/2 )) 


(b) 


(0 


: ClC 


- cos t — sin t 


+ c 2 e 


sint 
sin t + cos t 


(c) Use Ci = 2 and c 2 = 3 in answer to part (b). 

(d) lim 7(t) = lim V(t) = 0; no 

t—>oo t—> oo 

(b) r = Jtiy/kjm (d) \r\ is the natural frequency. 

(c) r\ = —1, 7° = ( 2 ) ; r 2 = ~ 4 ’ ? <2) = ^ ^ 

(d) jci = 3ci cos t + 3c 2 sin t + 3c 3 cos 2 1 + 3c4 sin 2t, 
x 2 = 2ci cos t + 2c 2 sin t — 4c 3 cos 2t — 4c 4 sin 2 1 
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(e) x[ = — 3ci sin 7 + 3c 2 cos 7 — 6c 3 sin 27 + 6c 4 cos 27, 
x ! 2 = — 2ci sin 7 + 2c 2 cos 7 + 8c 3 sin 27 — 8c 4 cos 27 


30. (a) A = 


(b) r\ — i, = 


/ 0 0 1 0 \ 

0 0 0 1 

-4 3 0 0 

\ 9/4 -13/4 0 0 ) 

( 1 \ 

1 


; r 2 = -i, = 


/ 1 \ 
1 
—i 



V 7 

V 

~i 7 


4 ^ 


4 \ 

r 3 = |i, S (3) = 

-3 

10/ 

-fi J 

; r 4 = -|i, | <4) = 

-3 

—10/ 

T< 7 


(c) y = ci 


/ COS 7 \ 


/ sin 7 \ 


COS 7 


sin 7 


— sin 7 

+ C2 

cos 7 

+ c 3 

y — sin 7 ) 


\ cos 7 y 



(e) ci = y, c 2 = 0 , c 3 = y c 4 = 0 . 

31. (a) A = 


7 ■ 

/ 0 
0 

-2 


/ 4 cos |7 \ 

—3 cos \ t 
-10 sin 17 


\ 2 2 

period = 47T. 


+ c 4 




o 


l o \ 


o o 


l 


0 0 


V 1 -2 0 0 / 


II 

Mr 

II 

c 

& 

1 ^ 

1 

i 

; r 2 = -i,^ = 

1 \ 
1 

—i 


1 7 


7 


r 3 = V3/, = 


1 \ 

-1 

a/3i 

-V3; / 


; n = -¥>U | <4) = 


1 \ 

-1 

-V3i 

V3i 7 




/ COS 7 

\ 


/ sin 7 \ 



COS\/3 7 \ 

(c) y = 


COS 7 


+ C2 

sin 7 

+ c 3 


— cos V3 7 

= Cl 

— sin 7 


cos 7 


—V^sinV^ 7 



^ — sin 7 

) 


\ cos 7 j 



V3sinV3 7 / 

(e) ci 

= 1, 

c 2 = 0, 

Cl 

; = -2, 

, c 4 = 0. 





+ c 4 


Section 7.7, page 427 



(~\e f + tc 2r 

l e -t _ 2 e 2t\ 

1 . (b) <J> (t) = 

1 2 -/ , 2 2t 

3 3 1 

4 —t 12 1 1 


\-i e +i e 

3 e ~ ¥ ) 


fie-'/ 2 + ±e~‘ 

e~ f / 2 — c — 

2. (b) 4>(f) = 

\\ e ~" 2 ~ \e~' 

\p-t/2 _i_ 1 ^,-i 
2 ^ ^ 2^ 


(¥ ~ \ e ~‘ 

-i^+ig-A 

3. (b) <t>(t) = 

\¥ - l e " 



4 sin |7 
—3 sin 17 
10 cos 17 
-yCOs| 7 ) 


( sin V3 7 \ 

— sin V3 7 
V3 cos \/3 7 
\ -V3cosV3 7 / 
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4. (b) 0(0 = 


\e 3t + \e 2t 


5 


— \e 3t + \e 2t 


+ \e 2 < 


5 

1 


+ y 2t 


5 (b) 0(0 = 


(cos t + 2 sin £ 


6. (b) 0(0 = 


-( 


sirU 

e~ f cos 2 1 
\e~ f sin2£ 


—5 sin t \ 
cos t — 2 sin t) 

-2e _r sin 2 A 
e~ l cos 2 1) 


7 . (b) *(0 = 1 

/l e 2t + 2_ e 4t l_ e 2t 

\ — \e 2t + \e At \e 2t 

~¥\ 

- ¥') 



8. (b) <I>(0=| 

(e~ f cos t + 2e~ l sin t 
l 5e~ f sin t 

—e~ l sin t 

e~ l cos t — 2e~ l 

sin 



/ -2c- 2r + 3c- ? 

—e~ 2t + e~ f 


—c 2r + e l 

9. (b) *(0 = 

\e~ 2t — 4e~ f + \e 2t 

“2 p -2t _ 4 -t , 13^,2 t 
4 C 3 C ^ 12 e 

\e~ 2 ' - le~‘ - 


\ \e~ 2t — 2e~ f — \e 2t 

l p -2t _ 2 -t _ 

_ 13 

12 ^ 

l p -2t _ 2 -t _ 
4 ^ 3^ 


( \e l + \e~ 2t + \e 3t 

— Ipt 1^-21 

3 e ^ 3 e 


— c _2r + 

10. (b) <D(0 = 

— \e x - \e~ 2t + e 3t 

4 pt _ 1^-21 
3 e 3 e 


— 2e l + c _2r + e 3t 


\e~ 2t +\e 3t 

1 p t _ \p-2t 

3 e 3 e 

- 

\e l + c _2r + |e 3 *y 


L p 2t 

L2 e 

L*2t 


“ -id 


''- 5 ( 3 )'"' 


12. x = ^ e f cos 2t + 


( sin 2£ 


17. (c) x = 

Section 7.8, page 436 
(c) x = 


( U ° ^ cos cot + f V ° 2 ^ 

V ^0 / V -^Wo / 


sin cot 


co 


2. (c) x = 

3 (c) x = ci 
4. (c) x = 


c '(i) e ' + C! [(i)“' + (o)‘'. 
c, 0) +ci [©'"(?)] 


+ C 2 


te~ l + 1 


p -t/2 


+ C 2 


Ch'MIM 



7 - i! " *“( 2 + 1 !)' 


8. (a) x = 


-6 
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9. (a) x = 

11. (a) x = 


e t/2 + 3 ( A {e l/2 

2} 2\-l) 




10. (a) x = 2 ( ; ) + 14 I 1 1 


i\ / o\ /o\ 

2 \e‘ + 4 1 \te‘ + 3 0 \e 2t 

33/ \—6/ \1/ 



l 2 .(a)x=^0e-' /2 + i(Je- /2 


13. x = c\ 


(i) ,+c2 [(i) 




14. x = ci ( 0 t 3 + c 2 


16. (b) 


3 \nt — 3 ' 


- t /2 + 


te t/2 + | 


r-tn 


yVj \-2) 

17. (d) 5 - -£ (1) (e) 5 - —(&i + k 2 )^\ k x +k 2 j^ 0 

18. (b) x (1) (0 = ^ 1^ e 2t 

(c) x (2) (0 — | ij te 2 ‘ + 1 1 j e 2t 

(d) x (3) (0 = ( 1 | (t 2 / 2 )e 2t + |l j te 2t + |() j e 2r 


(e) ^(0 = e 2. 


- 1 ) 

( 0 
1 

-1 


1 

t +1 
-J 


f + 2 \ 

(? 2 / 2 ) +1 

-it 2 1 2)+ 3 j 



o 

1 

2 \ 


/— 3 

3 

2\ 

(f) T = 

1 

1 

° , 

T 1 _ 

3 

-2 

-2 


V-i 

0 

3/ 


v-i 

1 

1/ 


J = 


/2 1 
0 2 
\0 0 


19. (a) x (1) (0 = 1 1 1 j 
< —2\ 


x <2) (0 =| 2 I e' 
-3; 


(d) x (3) (0 = I —4 I ^ + I 0 I ^ 

2/ \1/ 
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( 1 

0 

-It \ { 

(i 

-2 

\ 

(e) 'l'(f) = e' 0 

2 

Vh 

o 

1 

0 

-4 

-4r 

V 2 

-3 

2 t + 1 / ! 

^ 2 

2 

2r + 1 ) 


(f) T = 


/I 

0 


n 

0 

\2 


-2 

-4 

2 


0 
1 
0 

X 2 

0 

(c) exp (JO = e xt 


\0 


20. (a) J 2 = 


°\ 

1 

V 

2A, 

A 2 

1 

0 


°\ 

0 

V 


j 3 = 



1 

-1/2 

0\ 


T -1 = 

0 

-1/4 

0 

9 


1-2 

3/2 

V 


(x 3 

3A. 2 \ 


A 4 

4X 3 \ 

0 

4 - 

J 4 = 

0 

4 


(d) x = exp(J0x° 



n 

0 

0\ 


1 ' 

* 2 /2 \ 

(c) exp (JO = e kt 

0 

1 

t 

22. (c) exp (JO = 

0 

1 

t 


\0 

0 

V 


0 

0 

i / 
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10. x = ci 



e 


-4t 




5 sint 

— cos t + 2 sin t 


) + ( 1 / 2 ) ?cosr - ( 5 ( 1 2 3 4 5 6 7 ) ?sin? 


12. x = [i ln(sin t) — ln(- cos *) — §* + 
+ [5 ln(sinf) — + C 2 ] (_ __ 



5 cos t 

2 cos t + sin t 


) 


5 sint 

— cos t + 2 sin t 


•) 


13. (a) *(f) - 


' c r/2 cos ^ c r/2 sin ^ 

4c _?/2 sin \t —4e~ t / 2 cos ^ 



sin 

4 - 4 cos \t 



18. [3(«! - a 2 ) ~ 4]/6 = ci, («! + a 2 + 3)/2 = c 2 


CHAPTER 8 Section 8.1, page 460 


1. (a) 1.1975, 1.38549, 1.56491, 1.73658 

(b) 1.19631, 1.38335, 1.56200, 1.73308 

(c) 1.19297, 1.37730, 1.55378, 1.72316 

(d) 1.19405, 1.37925, 1.55644, 1.72638 

2. (a) 1.59980, 1.29288, 1.07242, 0.930175 

(b) 1.61124, 1.31361, 1.10012, 0.962552 

(c) 1.64337, 1.37164, 1.17763, 1.05334 

(d) 1.63301, 1.35295, 1.15267, 1.02407 

3. (a) 1.2025, 1.41603, 1.64289, 1.88590 

(b) 1.20388, 1.41936, 1.64896, 1.89572 

(c) 1.20864, 1.43104, 1.67042, 1.93076 

(d) 1.20693, 1.42683, 1.66265, 1.91802 

4. (a) 1.10244, 1.21426, 1.33484, 1.46399 

(b) 1.10365, 1.21656, 1.33817, 1.46832 

(c) 1.10720, 1.22333, 1.34797, 1.48110 

(d) 1.10603, 1.22110, 1.34473, 1.47688 

5. (a) 0.509239, 0.522187, 0.539023, 0.559936 

(b) 0.509701, 0.523155, 0.540550, 0.562089 

(c) 0.511127, 0.526155, 0.545306, 0.568822 

(d) 0.510645, 0.525138, 0.543690, 0.566529 

6. (a) -0.920498, -0.857538, -0.808030, -0.770038 

(b) -0.922575, -0.860923, -0.812300, -0.774965 

(c) -0.928059, -0.870054, -0.824021, -0.788686 

(d) -0.926341, -0.867163, -0.820279, -0.784275 

7. (a) 2.90330, 7.53999, 19.4292, 50.5614 

(b) 2.93506, 7.70957, 20.1081, 52.9779 

(c) 3.03951, 8.28137, 22.4562, 61.5496 

(d) 3.00306, 8.07933, 21.6163, 58.4462 
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8. (a) 0.891830, 1.25225, 2.37818, 4.07257 

(b) 0.908902, 1.26872, 2.39336, 4.08799 

(c) 0.958565, 1.31786, 2.43924, 4.13474 

(d) 0.942261, 1.30153, 2.42389, 4.11908 

9. (a) 3.95713, 5.09853, 6.41548, 7.90174 

(b) 3.95965, 5.10371, 6.42343, 7.91255 

(c) 3.96727, 5.11932, 6.44737, 7.94512 

(d) 3.96473, 5.11411, 6.43937, 7.93424 

10. (a) 1.60729, 2.46830, 3.72167, 5.45963 

(b) 1.60996, 2.47460, 3.73356, 5.47774 

(c) 1.61792, 2.49356, 3.76940, 5.53223 

(d) 1.61528, 2.48723, 3.75742, 5.51404 

11. (a) -1.45865, -0.217545, 1.05715, 1.41487 

(b) -1.45322, -0.180813, 1.05903, 1.41244 

(c) -1.43600, -0.0681657, 1.06489, 1.40575 

(d) -1.44190, -0.105737, 1.06290, 1.40789 

12. (a) 0.587987, 0.791589, 1.14743, 1.70973 

(b) 0.589440, 0.795758, 1.15693, 1.72955 

(c) 0.593901, 0.808716, 1.18687, 1.79291 

(d) 0.592396, 0.804319, 1.17664, 1.77111 

15. 1.595, 2.4636 

16. e n+l = [2 0(d) - 1 ]/i 2 , \e n+1 \ < [1 + 2max 0 < r <i 10(01] h 2 , 

e n+1 = e Ttn h 2 , |ei| < 0.012, \e 4 \ < 0.022 

17. e n+1 = [20(0 - t n ]h 2 , \e n+1 \ < [1 + 2max 0 < r <i 10(01] h 2 , 

e n+1 = 2 e 21 n h 2 , |dI < 0.024, \e 4 \ < 0.045 

18. e n+ \ = \t n + d0(d) + 0 3 (d )]^ 2 

19. e n+1 = [19 - 1 5t n r 1/2 (t n )]h 2 /4 

20. d+i = {1 + tin + Hin)]~ 1/2 }h 2 /4 

21. e n+1 = {2- [0(d) + 2 t 2 n \ exp [-40(d)] - d exp[-2d0(d)]}/i 2 /2 

22. (a) 0(0 = 1 + (l/570sin57r£ (b) 1.2, 1.0, 1.2 (c) 1.1, 1.1, 1.0, 1.0 

(d) h < 1/^50^0.08 

24. e n+i = -\(\)"tin)h 2 

25. (a) 1.55, 2.34, 3.46, 5.07 (b) 1.20, 1.39, 1.57, 1.74 (c) 1.20, 1.42, 1.65, 1.90 

26. (a) 0 (b) 60 (c) -92.16 

27. 0.224 ^ 0.225 


Section 8.2, page 466 


1. (a) 1.19512, 

(b) 1.19515, 

(c) 1.19516, 

2. (a) 1.62283, 

(b) 1.62243, 

(c) 1.62234, 

3. (a) 1.20526, 

(b) 1.20533, 

(c) 1.20534, 

4. (a) 1.10483, 

(b) 1.10484, 

(c) 1.10484, 


1.38120, 

1.38125, 

1.38126, 
1.33460, 
1.33386, 
1.33368, 
1.42273, 
1.42290, 
1.42294, 
1.21882, 
1.21884, 
1.21884, 


1.55909, 

1.55916, 

1.55918, 

1.12820, 

1.12718, 

1.12693, 

1.65511, 

1.65542, 

1.65550, 

1.34146, 

1.34147, 

1.34147, 


1.72956 

1.72965 

1.72967 

0.995445 

0.994215 

0.993921 

1.90570 

1.90621 

1.90634 

1.47263 

1.47262 

1.47262 
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5. 


6 . 


7. 

8 . 

9. 

10 . 

11 . 

12 . 

15. 

16. 

17. 

18. 

19. 

20 . 
23. 
25. 


0.510164, 0.524126, 0.542083, 0.564251 
0.510168, 0.524135, 0.542100, 0.564277 
0.510169, 0.524137, 0.542104, 0.564284 


-0.924650, -0.864338, -0.816642, -0.780008 
-0.924550, -0.864177, -0.816442, -0.779781 
-0.924525, -0.864138, -0.816393, -0.779725 
20.8114, 55.5106 


(a) 

(b) 

(c) 

(a) 

(b) 

(c) 

(a) 2.96719, 7.88313, 

(b) 2.96800, 7.88755, 

(a) 0.926139, 1.28558, 

(b) 0.925815, 1.28525, 
(a) 3.96217, 5.10887, 

3.96218, 5.10889, 
1.61263, 2.48097, 
1.61263, 2.48092, 


(b) 

(a) 

(b) 

(a) 

(b) 

(a) 


20.8294, 55.5758 
2.40898, 4.10386 
2.40869, 4.10359 
6.43134, 7.92332 
6.43138, 7.92337 
3.74556, 5.49595 
3.74550, 5.49589 
-1.44768, -0.144478, 1.06004, 1.40960 
-1.44765, -0.143690, 1.06072, 1.40999 


0.590897, 0.799950, 

(b) 0.590906, 0.799988, 
e n+ i = (38/i 3 /3) exp (4^), 
e n+1 = (2/i 3 /3)exp(2£j, 
e n+x = (4/z 3 /3) exp(2^), 
h = 0.036 
h = 0.023 
h = 0.081 

1.19512, 1.38120, 1.55909, 
1.20526, 1.42273, 1.65511, 


1.16653, 1.74969 
1.16663, 1.74992 

\e n+ i\ < 37,758.8/z 3 on 0 < t < 2, |^| < 0.00193389 

\e n+ i\ < 4.92604 h 3 on 0 < t < 1, \a\ < 0.000814269 

\e n+1 \ < 9.85207/r 3 on0 < t < 1, \d\ < 0.00162854 


1.72956 

1.90570 


21 . 

24. 


h = 0.117 
1.62268, 1.33435, 


26. 1.10485, 1.21886, 


1.12789, 

1.34149, 


0.995130 

1.47264 


Section 8.3, page 471 


1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 


(a) 

(b) 

(a) 

(b) 

(a) 

(b) 

(a) 

(b) 


1.19516, 
1.19516, 
1.62231, 
1.62230, 
1.20535, 
1.20535, 
1.10484, 
1.10484, 

(a) 0.510170, 

(b) 


1.38127, 

1.38127, 

1.33362, 

1.33362, 

1.42295, 

1.42296, 
1.21884, 
1.21884, 


1.55918, 

1.55918, 

1.12686, 

1.12685, 

1.65553, 

1.65553, 

1.34147, 

1.34147, 


1.72968 

1.72968 

0.993839 

0.993826 

1.90638 

1.90638 

1.47262 

1.47262 


0.524138, 0.542105, 


(a) 

(b) 


0.564286 

0.520169, 0.524138, 0.542105, 0.564286 
-0.924517, -0.864125, -0.816377, -0.779706 
-0.924517, -0.864125, -0.816377, -0.779706 


(a) 2.96825, 7.88889, 

(b) 2.96828, 7.88904, 

(a) 0.925725, 1.28516, 

(b) 0.925711, 1.28515 

(a) 3.96219, 5.10890, 

(b) 3.96219, 5.10890, 

(a) 1.61262, 2.48091, 

(b) 1.61262, 2.48091, 

(a) -1.44764, -0.143543, 

(b) -1.44764, -0.143427, 


20.8349, 55.5957 
20.8355, 55.5980 
2.40860, 4.10350 
2.40860, 4.10350 
6.43139, 7.92338 
6.43139, 7.92338 
3.74548, 5.49587 
3.74548, 5.49587 
1.06089, 1.41008 
1.06095, 1.41011 


(a) 0.590909, 

(b) 0.590909, 


0.800000, 

0.800000, 


1.166667, 

1.166667, 


1.75000 

1.75000 
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Section 8.4, page 478 


1. (a) 

(b) 

(c) 
3. (a) 

(b) 

(c) 
5. (a) 

(b) 

(c) 

7. (a) 

(b) 

(c) 

8. (a) 

(b) 

(c) 

9 . (a) 

(b) 

(c) 

10. (a) 

(b) 

(c) 

11 . (a) 

(b) 

(c) 

12. (a) 

(b) 

(c) 


6 , 


1.7296801, 1.8934697 

1.7296802, 1.8934698 
1.7296805, 1.8934711 
1.906382, 2.179567 
1.906391, 2.179582 
1.906395, 2.179611 
0.56428577, 0.59090918 
0.56428581, 0.59090923 
0.56428588, 0.59090952 

2.96828, 7.88907, 20.8356, 55.5984 

2.96829, 7.88909, 20.8357, 55.5986 
2.96831, 7.88926, 20.8364, 55.6015 
0.9257133, 1.285148, 2.408595, 4.103495 
0.9257124, 1.285148, 2.408595, 4.103495 
0.9257248, 1.285158, 2.408594, 4.103493 
3.962186, 5.108903, 6.431390, 7.923385 
3.962186, 5.108903, 6.431390, 7.923385 
3.962186, 5.108903, 6.431390, 7.923385 


2. (a) 0. 

(b) 0. 

(c) 0. 
4. (a) 

(b) 

(c) 

(a) 

(b) 
(b) 


1.612622, 2.480909, 

1.612622, 2.480909, 

1.612623, 2.480905, 


993852, 0.925764 
.993846, 0.925746 
993869, 0.925837 
.4726173, 1.6126215 
.4726189, 1.6126231 
.4726199, 1.6126256 


0.779693, 

0.779692, 

0.779680, 


-0.753135 

-0.753137 

-0.753089 


3.745479, 5.495872 
3.745479, 5.495873 
3.745473, 5.495869 
-1.447639, -0.1436281, 1.060946, 1.410122 
-1.447638, -0.1436762, 1.060913, 1.410103 
-1.447621, -0.1447219, 1.060717, 1.410027 
0.5909091, 0.8000000, 1.166667, 1.750000 
0.5909091, 0.8000000, 1.166667, 1.750000 
0.5909092, 0.8000002, 1.166667, 1.750001 


Section 8.5, page 481 

1. (a) 1.26, 0.76; 1.7714, 1.4824; 2.58991, 2.3703; 3.82374, 3.60413; 

5.64246, 5.38885 

(b) 1.32493, 0.758933; 1.93679, 1.57919; 2.93414, 2.66099; 4.48318, 4.22639; 

6.84236, 6.56452 

(c) 1.32489, 0.759516; 1.9369, 1.57999; 2.93459, 2.66201; 4.48422, 4.22784; 

6.8444, 6.56684 

2. (a) 1.451, 1.232; 2.16133, 1.65988; 3.29292, 2.55559; 5.16361, 4.7916; 

8.54951, 12.0464 

(b) 1.51844, 1.28089; 2.37684, 1.87711; 3.85039, 3.44859; 6.6956, 9.50309; 

15.0987, 64.074 

(c) 1.51855, 1.2809; 2.3773, 1.87729; 3.85247, 3.45126; 6.71282, 9.56846; 

15.6384, 70.3792 

3. (a) 0.582, 1.18; 0.117969, 1.27344; -0.336912, 1.27382; -0.730007, 1.18572; 

-1.02134, 1.02371 

(b) 0.568451, 1.15775; 0.109776, 1.22556; -0.32208, 1.20347; 

-0.681296, 1.10162; -0.937852, 0.937852 

(c) 0.56845, 1.15775; 0.109773, 1.22557; -0.322081, 1.20347; 

-0.681291, 1.10161; -0.937841, 0.93784 

4. (a) -0.198, 0.618; -0.378796, 0.28329; -0.51932, -0.0321025; 

-0.594324, -0.326801; -0.588278, -0.57545 
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(b) -0.196904, 0.630936; -0.372643, 0.298888; -0.501302, -0.0111429; 

-0.561270, -0.288943; -0.547053, -0.508303 

(c) -0.196935, 0.630939; -0.372687, 0.298866; -0.501345, -0.0112184; 

-0.561292, -0.28907; -0.547031, -0.508427 

5. (a) 2.96225, 1.34538; 2.34119, 1.67121; 1.90236, 1.97158; 1.56602, 2.23895; 

1.29768, 2.46732 

(b) 3.06339, 1.34858; 2.44497, 1.68638; 1.9911, 2.00036; 1.63818, 2.27981; 

1.3555, 2.5175 

(c) 3.06314, 1.34899; 2.44465, 1.68699; 1.99075, 2.00107; 1.63781, 2.28057; 

1.35514, 2.51827 

6. (a) 1.42386, 2.18957; 1.82234, 2.36791; 2.21728, 2.53329; 2.61118, 2.68763; 

2.9955, 2.83354 

(b) 1.41513, 2.18699; 1.81208, 2.36233; 2.20635, 2.5258; 2.59826, 2.6794; 

2.97806, 2.82487 

(c) 1.41513, 2.18699; 1.81209, 2.36233; 2.20635, 2.52581; 2.59826, 2.67941; 

2.97806, 2.82488 


7. For h = 0.05 and 0.025: x = 10.227, y = —4.9294; these results agree with the exact 
solution to five digits. 

8. 1.543, 0.0707503; 1.14743, -1.3885 9. 1.99521, -0.662442 


Section 8.6, page 491 

1. (b) 02(0 — 0i (0 = 0.001^ oo as t oo 

2. (b) 0i(0 = ln[e7(2 - e')]; 0 2 (O - ln[l/(l - *)] 

3. (a, b) h = 0.00025 is sufficient, (c) h = 0.005 is sufficient. 

4. (a) y = 4e~ m + (t 2 / 4) (c) Runge-Kutta is stable for h = 0.25 but unstable for h = 0.3. 

(d) h = 5/13 = 0.384615 is small enough. 

5. (a) y = t 6. (a) y = t 2 


CHAPTER 9 Section 9.1, page 505 

1. (a) T\ — —1, § (1) = (l,2) r ; r 2 = 2, £ (2) = (2, 1) T (b) saddle point, unstable 

2. (a) r\ = 2, £ (1) = (l,3) r ; r 2 = 4, £ (2) = (l,l) r (b) node, unstable 

3. (a) r x — -1, £ (1) = (l,3) r ; r 2 = 1,^ (2) = (l,l) r (b) saddle point, unstable 

4. (a) r\ = r 2 = —3, £ (1) = (1,1 ) T (b) improper node, asymptotically stable 

5. (a) ri,r 2 = —l±z; £ (1) ,£ (2) — (2 ± /, \) T (b) spiral point, asymptotically stable 

6. (a) ri,r 2 = d hi; ^ (1) ,§ (2) = (2 ±/, 1) T (b) center, stable 

7. (a) ri,r 2 = 1 dt 2/; ^ (1) ,§ (2) = (1,1 =p i) T (b) spiral point, unstable 

8. (a) r x = -1, ? (1) = (l,0) r ; r 2 = —1/4, § (2) = (4, -3) r 
(b) node, asymptotically stable 

9. (a) n = r 2 = 1, £ (1) = (2, l) r (b) improper node, unstable 

10. (a) r u r 2 = ±3/; ^ (1) ,^ (2) = (2,-l±3/) r (b) center, stable 

11. (a) n = r 2 = -1; ? (1) = (l,0) r , $ (2) = (0,1) T 

(b) proper node, asymptotically stable 

(a) r x ,r 2 == (1 ± 3z)/2; ^ (1) ,^ (2) = (5,3 =p 3z) r (b) spiral point, unstable 

13. x 0 = 1, yo = 1; ri = V2, r 2 = — V2; saddle point, unstable 

14. xo = —1, yo = 0; r \ = —1,^2 = —3; node, asymptotically stable 

15. x 0 = —2, y 0 = 1; r x ,r 2 = — 1 ± V2z; spiral point, asymptotically stable 

16. x 0 = y/<5, yo = af//3; r 1? r 2 = ±^/p8i; center, stable 

17. c 2 > 4km , node, asymptotically stable; c 2 = 4Am, improper node, asymptotically stable; 
c 2 < 4km, spiral point, asymptotically stable 
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Section 9.2, page 517 


1 . 

2 . 

3 . 

4. 

5. 

6 . 

7. 

8 . 
9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 

17. 

19. 

21 . 

23. 


x 2 +y 2 = 16 


x = 4e~ f , y = 2e _2r , y = x 2 /8 
x = 4e~ f , y = 2e 2t , y = 32x -2 ; x = 4e~\ y = 0 
x = 4 cos t, y = 4 sin t , x 2 + y 2 = 16; x = —4 sin t, y = 4 cos t, 
x = */acos \[ab t, y = —\[b sin \[ab t\ (x 2 /a) + (y 2 /b) = 1 
(a, c) (—|, 1), saddle point, unstable; (0,0), (proper) node, unstable 
(a, c) (— a/3/3, — |), saddle point, unstable; (a/3/3, — |), center, stable 
(a, c) (0,0), node, unstable; (2,0), node, asymptotically stable; 

(0, |), saddle point, unstable; (—1,3), node, asymptotically stable 
(a, c) (0,0), node, asymptotically stable; (1,—1), saddle point, unstable; 

(1,-2), spiral point, asymptotically stable 
(a, c) (0,0), spiral point, asymptotically stable; 

(1 - y/2, 1 + a/2), saddle point, unstable; (1 + a/2, 1 - V2), saddle point, unstable 
(a, c) (0,0), saddle point, unstable; (2,2), spiral point, asymptotically stable; 
(-1,-1), spiral point, asymptotically stable; (—2,0), saddle point, unstable 
(a, c) (0,0), saddle point, unstable; (0,1), saddle point, unstable; 

(|,|), center, stable; (— \,\), center, stable 

(a, c) (0,0), saddle point, unstable; (V6,0), spiral point, asymptotically stable; 

(—a/6,0), spiral point, asymptotically stable 

(a, c) (0,0), saddle point, unstable; (—2,2), node, unstable; 

(4,4), spiral point, asymptotically stable 

(a, c) (0,0), saddle point, unstable; (2,0), saddle point, unstable; 

(1,1), spiral point, asymptotically stable; (-2,-2), spiral point, asymptotically stable 
(a, c) (0,0), node, unstable; (1,1), saddle point, unstable; 

(3,-1), spiral point, asymptotically stable 

(a, c) (0,1), saddle point, unstable; (1,1), node, asymptotically stable; 

(—2,4), spiral point, unstable 

(a) 4x 2 — y 2 = c 18. (a) 4x 2 + y 2 = c 

(a) (y — 2x) 2 (x + y) = c 20. (a) arctan(y/x) - In -Jx 2 + y 2 = c 

(a) 2x 2 y -2 xy + y 2 = c 22. (a) x 2 y 2 - 3x 2 y - 2y 2 = c 

(a) (y 2 / 2) — cosx = c 24. (a) x 2 + y 2 — (x 4 /12) = c 


Section 9.3, page 527 

linear and nonlinear: saddle point, unstable 

2. linear and nonlinear: spiral point, asymptotically stable 

3. linear: center, stable; nonlinear: spiral point or center, indeterminate 

4. linear: improper node, unstable; nonlinear: node or spiral point, unstable 

5. (a,b, c) (0,0); u' = —2u + 2v, v' = 4u + 4v; r = 1 ± a/17; 
saddle point, unstable 

(—2,2); u' = 4u, i/ = 6u + 6v; r = 4,6; node, unstable 

(4,4); u' = —6u + 6v , v' = —8 u; r = — 3 ± \/39 /; spiral point, asymptotically 

stable 

6. (a, b, c) (0,0); u'= u, v'= 3v; r = 1,3; node, unstable 

(1,0); u' = —u — v, v' = 2v; r = —1,2; saddle point, unstable 

( 0 , |); u' = — \u, v' = — \u — 3v; r = — — 3 ; node, asymptotically stable 

(— 1 , 2 ); u! — u + v, v' = — 2u — 4v; r = (—3 ± a / 17 )/ 2 ; saddle point, unstable 
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7. (a,b, c) (1,1); u' = —a, a' = 2 u — 2a; r — — 1 ± /; spiral point, asymptotically 
stable 

(—1,1); u' = —a, v' = —2u — 2a; r = — 1 ± V3; saddle point, unstable 

8. (a,b, c) (0,0); u'= u, v' = \v\ r = 1, ~; node, unstable 

(0,2); u' = —u, v' = — \u — |a; r = —1, node, asymptotically stable 
(1,0); u' = —u — a, v' = — ^a; r = —1, — \\ node, asymptotically stable 

(i,|); u! — — \u— \v, v' = —^u—\v\ r = (—5 ± \/57)/16; 
saddle point, unstable 

9. (a, b, c) (0,0); u' = —u + 2a, a' = u + 2a; r = (1 ~fc VT7/2; saddle point, unstable 

(2.1) ; w' = — |w + 3a, a' = — 2u\ r = (—3 ± V870/4; spiral point, asymptotically 

stable 

(2,-2); u' = — 3a, a ' = u; r = ±V?>i; center or spiral point, indeterminate 

(4, —2); u' = —4a, v' = — u — 2a; r = — 1 ± V5; saddle point, unstable 

10. (a,b, c) (0,0); u'= u, v' = a; r = 1,1; node or spiral point, unstable 

(—1,0); u' = —u, v' = 2a; r = —1,2; saddle point, unstable 

11. (a,b, c) (0,0); u' = 2u + a, v' = u — 2a; r = ±V5; saddle point, unstable 

(-1.1935, -1.4797); u' = -1.2399 u - 6.8393a, v' = 2M91u - 0.80655a; 

r = —1.0232 ± 4.1125/; spiral point, asymptotically stable 

12. (a,b,c) (0,±2wr), n — 0,1,2,...; u' = a, a ’ ——u\ 
r = ±i; center or spiral point, indeterminate 

[2, ±(2n — l)7r], n = 1,2,3,...; u'= — 3a, a ' =—u; r = ±V3; 
saddle point, unstable 

13. (a,b, c) (0,0); u'= u, v' = a; r = 1,1; node or spiral point, unstable 

(1.1) ; u'= u — 2a, a' = — 2w + a; r = 3, —1; saddle point, unstable 

14. (a, b, c) (1,1); u' = —u — a, v' = u — 3a; r = — 2,-2; 
node or spiral point, asymptotically stable 

(—1, —1); w' = w + a, v' = u — 3v; r = —13- V5; saddle point, unstable 

15. (a, b, c) (0,0); w' = —2w — v, v' = u — v; r = (—3 ± V3 /)/2; 
spiral point, asymptotically stable 

(-0.33076, 1.0924) and (0.33076, -1.0924); u' = -3.5216 u - 0.27735a, 
a r = 0.27735w + 2.6895a; r = —3.5092, 2.6771; saddle point, unstable 

16. (a, b, c) (0,0); u' = u + a, v' = — u + a; r = 1 ± /; spiral point, unstable 

17. (a,b,c) (2,2); u' = —4a, v' = — \u+ r = (7 ± \/273)/4; saddlepoint, unstable 
(—2, —2); u' = 4a, v r = \u — \v\ r = (—1 ± \/33)/4; saddle point, unstable 

(— §,2); u' = — 4a, v' = \u\ r = ±\/l4/; center or spiral point, indeterminate 

(— |, —2); u' = 4a, a' = — r = ±V2 /; center or spiral point, indeterminate 

18. (a,b, c) (0,0); u' = 2u — a, a' = 2w — 4a; r = — 1 ± V7; saddle point, unstable 

(2.1) ; w' = —3a, a' = 4 u — 8a; r = —2, —6; node, asymptotically stable 

(—2,1); u' = 5a, a ; = —4u; r = ±2a/ 5/; center or spiral point, indeterminate 

(—2, —4); w' = 10 u — 5a, v' = 6u; r = 5 ± V5 /; spiral point, unstable 

21. (b, c) Refer to Table 9.3.1. 

23. (a) R = A, T = 3.17 (b) R = A, 3.20, 3.35, 3.63, 4.17 

(c) T 7i as A —> 0 (d) A = n 

24. (b) a c = 4.00 25. (b) a c = 4.51 

30. (a) dx/dt = y, dy/dt = —g(x) — c(x)y 

(b) The linear system is dx/dt = y, dy/dt = —g f (0)x — c(0)y. 

(c) The eigenvalues satisfy r 2 + c(0)r + g'(0) = 0. 
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Section 9.4, page 541 

1. (b,c) (0,0); zz 7 = |zz, v' =2v; r= |,2; node, unstable 

(0,2); zz 7 = \u, v' = — |zz — 2v\ r = 2; saddle point, unstable 

(|,0); u'= — |zz — |u, v'= r = — 1,|; saddle point, unstable 
(|,|); u'= — \u— |d, v'= — %u— r = (—22 ± V204)/20; 
node, asymptotically stable 

2. (b, c) (0,0); zz 7 = |zz, v’— 2v\ r= |,2; node, unstable 

(0,4); zz 7 = — |zz, i/ = —6zz — 2i>; r = —^,—2; node, asymptotically stable 

(|,0); zz 7 = — |zz — |u, u 7 = — |a; r = — J, —|; node, asymptotically stable 

(1.1) ; u! — — zz — \v, v' — —\u—\v\ r = (—3 ± >/l3)/4; 

saddle point, unstable 

3. (b,c) (0,0); zz 7 = |zz, v r = 2v\ r= |,2; node, unstable 

(0,2); zz 7 = — 1 m, v' = — \u — 2v; r = — |, —2; node, asymptotically stable 

(3,0); zz 7 = — |zz — 3v, = r = — |,— y; node, asymptotically stable 

(f,{±); u' = -\u-\v, v' = -^u-^v; r = -1.80475, 0.30475; 
saddle point, unstable 

4. (b, c) (0,0); u! — |zz, v' = |u; r = |,|; node, unstable 

(0, |); zz 7 = |zz, v' = — |u; r = =t|; saddle point, unstable 

(3,0); u! — —\u — 2)V, v' = |u; r = —1,|; saddle point, unstable 

(2.1) ; u' = -u- 2v, v' = -±u- \v\ r = —1.18301, -0.31699; 
node, asymptotically stable 

5. (b, c) (0,0); zz 7 = zz, v' = \v\ r = 1, |; node, unstable 

(0, |); zz 7 = — 1 m, v' = — \u— |u; r = — — |; node, asymptotically stable 

(1,0); zz 7 = —zz — v , i/ = lu; r = —1,1; saddle point, unstable 

6. (b, c) (0,0); zz 7 = zz, v' = |u; r = 1, |; node, unstable 

(0, |); zz 7 = ^-zz, i/ = ^zz — |u; r = — |; saddle point, unstable 

(1,0); zz 7 = — zz + ~r>, i/ = r = —1, saddle point, unstable 

(2.2) ; zz 7 = —2zz 4- u, u 7 = |zz — 3u; r = (—5 ± V3)/2; 

node, asymptotically stable 

8. (a) Critical points are x = 0,y = 0; x = £i/ai,y = 0; x = 0,y = £ 2/^2 • 
x -> 0, y £ 2/^2 as t 00 ; the redear survive. 

(b) Same as part (a) except x -> £i/ai,y -> 0 as t -> 00 ; the bluegill survive. 

9. (a) X = (B- Y iR)/( 1 - xm), y = (* - yiB)/a - yi y 2 ) 

(b) X is reduced, Y is increased; yes, if B becomes less than y\R , then x 0 and y -> R 
as t —> 00 . 

10 . (a) (Ji £2 — cz 2 £i 7 ^ 0: (0,0), (0, £ 2 / 02 ), (£1 /c^i, 0) 

zti£ 2 — cz 2 £i = 0: (0,0), and all points on the line oyx, + a\y = £1 

(b) cti£ 2 — cz 2 £i > 0: (0,0) is unstable node; (£i/tri,0) is saddle point; 

(0, £ 2 /^ 2 ) is asymptotically stable node. 

01 £ 2 — cz 2 £i < 0: (0,0) is unstable node; (0,£ 2 /^ 2 ) is saddle point; 

(£i/<7i,0) is asymptotically stable node. 

(c) (0,0) is unstable node; points on the line oix + ot\y = £1 are stable, nonisolated critical 
points. 

12. (a) (0,0), saddle point; (0.15,0), spiral point if y 2 < 1.11, node if y 2 > 1.11; (2,0), saddle 
point 

(c) y = 1.20 
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13. (b) (2 — ^4 — |a, |a), (2 + ^4- §a, |a) 

(c) (1,3) is an asymptotically stable node; (3,3) is a saddle point 

(d) a 0 = 8/3; critical point is (2,4); k = 0, — 1 

14. (b) (2-^4- |a, |a), (2 + ^4- |a, |a) 

(c) 1,3) is a saddle point; (3,3) is an unstable spiral point 

(d) ao = 8/3; critical point is (2,4); X = 0,1 

15. (b) ([3 - V9 - 4a\ / 2 , [3 + 2 a - V9-4a]/2), 

([3 + V9 - 4a]/2, [3 + 2a + V9 - 4a]/2) 

(c) ( 1 ,3) is a saddle point; ( 2 ,4) is an unstable spiral point 

(d) a 0 = 9/4; critical point is (3/2,15/4); A = 0,0 

16. (b) ([3 - V9 - 4a]/ 2 , [3 + 2 a - V9-4a]/2), 

([3 + V9^4^]/2, [3 + 2a + V9^4a]/2) 

(c) ( 1 ,3) is a center of the linear approximation and also of the nonlinear system; ( 2 ,4) is 
a saddle point 

(d) do = 9/4; critical point is (3/2,15/4); A = 0,0 

17. (b) Pi (0,0), P 2 (l, 0 ), Ps(0,a), P 4(2 — 2a, — 1 + 2a). P 4 is in the first quadrant for 

0.5 < a < 1. 

(c) a = 0;P 3 coincides with Pi. a = 0.5; P 4 coincides with P 2 . a = 1;P 4 coincides with 
P3. 

1 — 2 x — y —x 

— 0.5y a — 2 y — 0.5x 

(e) Pi is an unstable node for a > 0. P 2 is an asymptotically stable node for 0 < a < 0.5 
and a saddle point for a > 0.5. P 3 is a saddle point for 0 < a < 1 and an asymptotically 
stable node for a > 1. P 4 is an asymptotically stable node for 0.5 < a < 1. 

18. (b) Pi(0,0), P 2 (1,0), P 3 (0,0.75/a), P 4 [(4a - 3)/(4a - 2),l/(4a - 2)]. P 4 is in the 

first quadrant for a > 0.75. 

(c) a = 0.75; P 3 coincides with P 4 . 

1 — 2 x — y —x 

— 0.5y 0.75 — 2ay — 0.5x 

(e) Pi is an unstable node. P 2 is a saddle point. P 3 is an asymptotically stable node for 
0 < a < 0.75 and a saddle point for a > 0.75. P 4 is an asymptotically stable node for 
a > 0.75. 




19. (b) Pi(0,0), P 2 (1,0), P 3 (0,a), P 4 ( 0 . 5 ,0.5). In addition, for a = 1 every point on the 

line x + y = 1 is a critical point. 

(c) a = 0; P 3 coincides with Pi. Also a = 1. 

1 — 2 x — y —x 

— ( 2 a — l)y a — 2 y — ( 2 a — l)x 


(d) J = 


(e) Pi is an unstable node for a > 0. P 2 and P 3 are saddle points for 0 < a < 1 and asymp¬ 
totically stable nodes for a > 1. P4 is an asymptotically stable spiral point for 
0 < a < 0.5, an asymptotically stable node for 0.5 < a < 1, and a saddle point for a > 1. 


Section 9.5, page 551 

1. (b, c) ( 0 , 0 ); u' = |m, v' = — r = |, — \\ saddle point, unstable 

(|,3); u' = — ~v, v' = 3u\ r = ±V3//2; center or spiral point, indeterminate 

2 . (b, c) ( 0 , 0 ); u! — u, v' = — r — 1 ,- 1 ; saddle point, unstable 
(|, 2 ); u'= — \v, v' = u\ r = ± 1 /; center or spiral point, indeterminate 
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3. 


4. 


5. 


6 . 


7. 


8 . 


9. 


11 . 


12 . 


13. 


14. 


15. 


16. 


(b,c) (0,0); 

( 2 , 0 ); 

(|,§); = 

asymptotically stable 


i , 


u = u , u' = — | v ; 

r = -l 


a = —a — v, v = fv; 

„/ _ i„ i 


r = 1, — J; saddle point, unstable 
|; saddle point, unstable 


u' = | u\ 


1 = (—1 ± \/TT /)/8; spiral point, 


(b,c) (0,0); 
( 1 , 0 ); 


( 1 , 1 ); 


a, v' = —v; r = |, — 1; saddle point, unstable 
r = — ||; saddle point, unstable 


/ 9 9/1 

W =“8^-16^ ” = 8 V’ 


u' = — u — \v, v' = \u\ r = (— 1 ± Vo3)/2; node, asymptotically stable 


a = — u, 


r = — 1 , — |; node, asymptotically stable 


u r = \u — v, v' = — d; r—— 1 ,|; 

i/ = — 3u — |d, i/ = in; r — —3, 


/ 3 9 

W = ~4 U ~^ V ’ 


v' = | w; 


saddle point, unstable 
2 , saddle point, unstable 
r = (—3 =b y/39i)/8 ; spiral point, 


(b,c) (0,0); 

(|, 0 ); 

( 2 , 0 ); 

(3 5 
^ 2 » 3 ^’ 

asymptotically stable 
(b,c) r = o,r, 27,...: //is a max., dP/dt is a max. 

t = 7/4,57/4,... : dH/dt is a min., 7 is a max. 

t — 7/2,37/2,... : H is a min., TP/dt is a min. 

£ = 37/4,77/4,... : dH/dt is a max., 7 is a min. 

(a) ^ca/Jay (b) V3 

(d) The ratio of prey amplitude to predator amplitude increases very slowly as the initial 
point moves away from the equilibrium point. 

(a) 4 tt/V3 S 7.2552 


(c) The period increases slowly as the initial point moves away from the equilibrium point, 

(a) 7 = 6.5 (b) 7 = 3.7, 7 = 11.5 (c) 7 = 3.8,7^11.1 

(a) 7i(0, 0 ), 7 2 (l/< 7 , 0 ), 7 3 (3,2 — 6 a); P 2 moves to the left and 7 3 moves down; they 
coincide at (3,0) when o = 1/3. 

(b) 7 X is a saddle point. 7 2 is a saddle point for a < 1/3 and an asymptotically stable node 
fora > 1/3.7 3 is an asymptotically stable spiral point for a < a 3 = (^7/3 — l)/2 = 0.2638, 
an asymptotically stable node for a 3 < a < 1/3, and a saddle point for a > 1/3. 

(a) 7i(0,0), 7 2 (fl/a, 0), 7 3 [c/y, (a/a) — (ca/ay)]; 7 2 moves to the left and 7 3 moves 
down; they coincide at (c/y, 0 ) when a = ay/c. 

(b) P\ is a saddle point. 7 2 is a saddle point for a < ay/c and an asymptotically stable 
node for a > ay/c. 7 3 is an asymptotically stable spiral point for sufficiently small values 
of a and becomes an asymptotically stable node at a certain value a 3 < ay/c. P 3 is a saddle 
point for a > ay/c. 

(a, b) 7x(0,0) is a saddle point; 7 2 (5,0) is a saddle point; 7 3 (2,2.4) is an asymptotically 
stable spiral point. 

(b) same prey, fewer predators (c) more prey, same predators 

(d) more prey, fewer predators 

(b) same prey, fewer predators (c) more prey, fewer predators 
(d) more prey, even fewer predators 

(b) same prey, fewer predators (c) more prey, same predators 
(d) more prey, fewer predators 


Section 9.7, page 574 

1 . r = 1 , G = t + to, stable limit cycle 2 . r = 1 , 0 = — t + to, semistable limit cycle 

3. r = 1, 9 = t + t 0 , stable limit cycle; r — 3, 0 = £ + £ o , unstable periodic solution 

4. r = 1, 0 t + t 0 , unstable periodic solution; r = 2, 0 t + t 0 , stable limit cycle 

5. r = 2n — 1, 0 = t + to, n — 1,2,3,..., stable limit cycle; 

r = 2n, 0 = t + to, n = 1 , 2 ,3,..., unstable periodic solution 



Answers to Problems 


635 


6 . r = 2, 0 = — t + to, semistable limit cycle; 
r = 3, 0 = — t + t 0 , unstable periodic solution 

8. (a) Counterclockwise 

(b) r = 1 , 0 = t + t 0 , stable limit cycle; r = 2, (9 = t + f 0 , semistable limit cycle; 
r = 3, 0 = t + unstable periodic solution 

9. r = 72, 0 = — t + t 0 , unstable periodic solution 

14. (a) /x = 0.2, T = 6.29; /x = 1, T = 6 . 66 ; /x = 5, T = 11.60 

15. (a) x' = y, y' = -x + /xy - /xy 3 /3 

(b) 0 < /x < 2 , unstable spiral point; /x > 2 , unstable node 

(c) A = 2.16, T = 6.65 

(d) /x = 0.2, A = 1.99, P = 6.31; /x = 0.5, A = 2.03, T = 6.39; 

/i = 2, A = 2.60, P = 7.65; /jl = 5, A = 4.36, T = 11.60 

16. (b) x' = /xx + y, y = —x + /xy; A = /x ± /; the origin is an asymptotically stable 
spiral point for /x < 0 and an unstable spiral point for /x > 0 . 

(c) r' = r(/x — r 2 ), = —1 

17. (a) The origin is an asymptotically stable node for /x < —2, an asymptotically stable spiral 
point for — 2 < /x < 0 , an unstable spiral point for 0 < /x < 2 , and an unstable node for 
/x > 2 . 

18. (a, b) ( 0 , 0 ) is a saddle point; ( 12 , 0 ) is a saddle point; ( 2 , 8 ) is an unstable spiral point. 

19. (a) (0,0), (5a, 0), (2,4a -1.6) 

(b) r = -0.25 + 0.125a ± 0.025V220 - 400a + 25a 2 ; a 0 = 2 

20. (b) A. = [-(5/4 -b)± sj (5/4 - W - l] /2 

(c) 0 < b < 1/4: asymptotically stable node; 1/4 < b < 5/4: asymptotically stable spiral 
point; 5/4 < b < 9/4: unstable spiral point; 9/4 < b; unstable node 

(d) b 0 = 5/4 

21. (b) k = 0, (1.1994, -0.62426); k = 0.5, (0.80485, -0.13106) 

(c) k 0 = 0.3465, (0.95450, -0.31813) 

(d) k = 0.4, T = 11.23; k = 0.5, T = 10.37; k = 0.6, T = 9.93 

(e) k\ = 1.4035 

Section 9.8, page 584 

1. (b) k = ki, £ (1) = (0,0, l) r ; 7 = A 2 , ^ (2) = (20,9 — V81 + 40r, 0) T ; 
k = k 3 , ? (3) = (20,9 + 781 + 40r, 0) r 

(c) k\ = -2.6667, ? (1) = (0,0, 1) T ; k 2 = -22.8277, ? (2) = (20, -25.6554,0) r ; 
k 3 = 11.8277, ? (3) = (20,43.6554,0) r 

2. (c) k\ = -13.8546; A. 2 ,A . 3 = 0.0939556 ± 10.1945/ 

5. (a) dV/dt = -2cr[rx 2 + y 2 + 6(z - r ) 2 - br 2 ] 

11. (b) c = Vo3 : Pi(V2/4, -72,72); A = 0 , -0.05178 ± 1.5242/ 

c = 1 : Pi = (0.8536, -3.4142,3.4142); A. = 0.1612, -0.02882 ± 2.0943/ 

P 2 (0.1464, -0.5858,0.5858); k = -0.5303, -0.03665 ± 1.1542/ 

12. (a) Pi(1.1954,-4.7817,4.7817); k = 0.1893,-0.02191 ± 2.4007/ 

P 2 (0.1046, -0.4183,0.4183); k = -0.9614,0.007964 ± 1.0652/ 

(d) Pi = 5.9 

13. (a, b, c) ci = 1.243 

14. (a) Pi(2.9577, -11.8310,11.8310); k = 0.2273, -0.009796 ± 3.5812/ 

P 2 (0.04226, -0.1690,0.1690); 1 = -2.9053,0.09877 db 0.9969/ 

(c) P 2 = 11.8 

15. (a) Pi(3.7668, -15.0673,15.0673); k = 0.2324, -0.007814 ± 4.0078/ 

P 2 (0.03318, -0.1327,0.1327); 1 = -3.7335,0.1083 ± 0.9941/ 

(b) P 4 = 23.6 
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functions of, 313 
Exponents at the singularity, 
284,289 

F 

Falling object problem, 2-4, 
13-15 

Fehlberg, Erwin, 471 


Feigenbaum, Mitchell, 133 
Feigenbaum number, 133 
Ferrari, Ludovico, 230 
First order ordinary differential 
equations 

applications of, 51-68,78-95 
Bernoulli, 77 
direction field, 3,5 
exact, 95-99 

existence and uniqueness 
theorems, 69-73,112-122 
proof of, 113-119 
general solution of, 12,37,74 
graphical construction of 
integral curves, 75 
homogeneous, 27,49-51 
implicit solutions, 74-75 
integrating factor for, 32,36, 
99-100 

interval of definition, 37,45, 
46,73-74 
linear, 27,31-42 
nonlinear, 68-78 
numerical solution of, see 
Numerical methods 
separable, 42-51 
series solution of, 270 
systems of, see Systems 
Fitzhugh, Richard, 577 
Fitzhugh-Nagumo equations, 
577 

Frequency, natural 

of simple harmonic motion, 
197 

Frobenius, Ferdinand Georg, 
283,368,495 
Frobenius 
method of, 283 

Fuchs, Lazarus Immanuel, 267, 
495 

Fundamental matrix, 421-429, 
433-434 

Fundamental modes of 
vibration, 415 

Fundamental set of solutions, 
150,151,223,392,393 
Fundamental theorem of 
algebra, 228 


G 

Galois, Evariste, 230 
Gamma function, 316 
Gauss, Carl Friedrich, 228,373 
Gaussian elimination, 373 
Gear, C. William, 476 
General solution of linear 
equations 

first order, 12,37,74 
nth order, 223 
second order, 141,150,162, 
169,176 

systems of first order 
equations, 392 
Generalized function, 345 
Global asymptotic stability, 527 
Gompertz, Benjamin, 90 
Gompertz equation, 90 
Graphical construction of 
integral curves, 75 
Gravity, 2,58 

H 

Half-life, 17,62 
Harvesting a renewable 
resource, 91 

Heat conduction equation, 19 
Heaviside, Oliver, 312 
Heaviside function, 328 
Hereditary systems, 351 
Hermite, Charles, 264,368 
Hermite equation, 264,282 
Hermite polynomials, 264 
Hermitian matrix, 264,387,403, 
424,425,430 
Heun, Karl, 463 
History of differential 
equations, 26-29 
Hodgkin, Alan L., 543 
Hodgkin-Huxley equations, 
543,577 

Homogeneous algebraic 
equations, 378 
Homogeneous differential 
equations, 

with constant coefficients, 28, 
137-145,158-175,228-236 
systems, 396-440 
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definition of, 138,363 
general theory of, 145-158, 
222-225,390-396 
Homogeneous first order 

differential equations, 27, 
49-51 

Hooke, Robert, 193 
Hooke’s law, 193 
Hopf, Eberhard, 575 
Hopf bifurcation, 575 
Huxley, Andrew E, 543 
Huygens, Christian, 356 
Hypergeometric equation, 295 

I 

Identity matrix, 372 
Implicit numerical method, 455, 
474,491 

Implicit solutions, 74-75 
Improper integrals, 309-311 
comparison theorem for, 311 
Improper node, 432,500,523 
Improved Euler method, 
462-468 

Impulse functions, 343-350 
Impulse of force, 343 
Impulse response, 354 
Indicial equation, 284,289,293 
Inductance, 202 
Initial conditions, 12,76,122, 
138,222,362 

Initial value problem, 12,45, 

138,222,362 

Laplace transform of, 317-324 
Inner product 
for vectors, 371 
Instability 

of critical point, 83,124,126, 
504,509,512,558 
of numerical method, 485-490 
of periodic orbit, 568 
see also Diverging solutions 
Integral curves, 12,75 
Integral equation, 113 
Volterra, 355 

Laplace transform of, 355 
Integral transform, 312 


Integrating factor, 27,32,36, 
99-100,157 

Integro-differential equation, 
356 

Laplace transform of, 356 
Interval of convergence, 248 
Inverse Laplace transform, 320 
as linear operator, 322 
uniqueness of, 320 
Inverse matrix, 372-375 
Invertible matrix, 372 
Irregular singular point, 278, 
295-296 
Iteration 

of difference equation, 123 
method of, 114 
see also Successive 
approximations 

J 

Jacobi, Carl Gustav Jacob, 522 
Jacobian matrix, 522,579 
Jordan, Camille, 368,434 
Jordan form of matrix, 434-435, 
438,439 

Jump discontinuity, 310 

K 

Kernel, 

of convolution, 192 
of integral transform, 312 
Kirchhoff, Gustav, 202 
Kirchhoff’s laws, 202,365 
Kutta, M. Wilhelm, 468 

L 

Lagrange, Joseph-Louis, 28,187, 
250 

Laguerre, Edmond Nicolas, 287 
Laguerre equation, 287 
Laplace, Pierre-Simon de, 
28,312 

Laplace transform, 309-357 
of convolution, 350-352 
definition of, 312 
of derivatives, 317-318 
of Dirac delta function, 
345-346 


existence of, 312 
of initial value problems, 
317-324 

of integral equations, 355 
of integro-differential 
equations, 356 
inverse of, 320 
as linear operator, 314 
of periodic functions, 334 
of rectified sine wave, 335 
of sawtooth wave, 335 
of square wave, 334 
for systems of equations, 
446-447 
table of, 320 

translation formula, 330,332 
of unit step function, 329 
Laplace’s equation, 28 
Legendre, Adrien Marie, 154, 
270 

Legendre equation of order a , 
156,158,254,268,270-272, 
278,281,286,327 
Legendre polynomials, 271 
Leibniz, Gottfried Wilhelm, 26, 
68,77,356 

Length, of a vector, 372 
L’Hopital, Marquis de, 68 
Liapunov, Alexandr M., 555 
Liapunov function, 558 
Liapunov theorems, 557 
Liapunov’s second method, 
554-565 

Libby, Willard F., 62 
Lienard, Alfred-Marie, 531 
Lienard equation, 531,563 
Limit cycle, 568 
Linear dependence and 
independence, 
of functions, 223,228 
of vector functions, 383 
of vectors, 382-383 
Linear operator, 240,314,322 
Linear ordinary differential 
equations 

adjoint equation, 157 
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change of independent 
variable, 165-167,276, 
307 

characteristic equation, 140, 
228,320 

complex roots, 158,230 

complex roots, repeated, 
232 

real and equal roots, 167, 
232 

real and unequal roots, 140, 
229 

complementary solution, 177 
definition of, 21,137 
Euler equation, 166,175,272 
exact, 157 

existence and uniqueness 
theorems, 69,146,222, 
266,293,363 
first order, 27,31-42 
fundamental set of solutions, 
150,151,223,392,393 
general solution of, 12,28,37, 
74,141,150,162,169,176, 
223,392 

homogeneous equation with 
constant coefficients, 28, 
137-145,158-175, 
228-236 

integrating factor, 27,32, 

36,157 

interval of definition, 37,69 
nonhomogeneous equation, 
138,175-192,225, 
236-245,440-449 
ordinary point, 254,266, 
270,281 

particular solution, 177,226 
reduction of order, 171-172, 
226 

self-adjoint, 158 
series solution of, see Series 
solution 

singular point, 254,266, 
272-281 

systems of, see Systems 
undetermined coefficients, 16, 
177-186,236-240 


variation of parameters, 28, 
41,186-192,241-245 
Linearization, 

of a nonlinear equation, 21 
of a nonlinear system, 522 
Liouville, Joseph, 114 
Lipschitz, Rudolf, 121 
Lipschitz condition, 121 
Locally linear systems, 519-531 
Logarithmic decrement, 205 
Logistic difference equation, 
125-131 

Logistic differential equation, 
80-84,125,532,551 
Logistic growth, 80-84,87-88 
Lorenz, Edward N., 578 
Lorenz equations, 577-585 
Lotka, Alfred I, 545 
Lotka-Volterra equations, 20, 
544-554 

M 

Magnitude, of a vector, 372 
Malthus, Thomas, 79 
Mascheroni, Lorenzo, 299 
Mathematical model, 2,51-52 
analysis of, 52 

comparison with experiment, 
52 

construction of, 7,15,51 
Matrices, 368-390 
addition of, 369 
adjoint, 369 
augmented, 373,379 
conjugate, 369 
diagonalizable, 424-426 
eigenvalues of, 384-388 
eigenvectors of, 384-388 
equality of, 369 
exponential, 423-424,428 
fundamental, 421-429, 
433-434 

Gaussian elimination, 373 
Hermitian, 264,387,403,424, 
425,430 
identity, 372 
inverse, 372-375 
invertible, 372 


Jordan form of, 434-435, 

438,439 

multiplication by a number, 
370 

multiplication of, 370-371 
noninvertible, 372 
nonsingular, 372 
row reduction of, 373 
self-adjoint, 387 
similar, 425 
singular, 372 
subtraction of, 370 
transpose, 369 
zero, 369 

Matrix functions, 375 
May, Robert M., 131 
Millikan, Robert A., 66 
Mixing problems, 52-54,57-58 
Modified Euler formula, 467 
Moulton, Forest Ray, 474 
Multiplicity of eigenvalue 
algebraic, 385 
geometric, 386 
Multistep method, 472-478 

N 

Nagumo, Jin-Ichi, 577 
Negative definite function, 557 
Negative semidefinite function, 
557 

Newton, Isaac, 68 
Newton’s law 

of cooling, 9,17,63 
of motion, 2,194,365 
Newton, Isaac, 26 
Node, 402,412,497,520,523, 
see also Improper node, 
Proper node 

Nonhomogeneous algebraic 
equations, 378 
Nonhomogeneous linear 

differential equations, 138, 
175-192,225,236-245, 
353-354,363,440-449 
Noninvertible matrix, 372 
Nonlinear ordinary differential 
equations 

autonomous systems, 508-585 
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definition of, 21,138 
existence and uniqueness 
theorems, 70,113,362 
first order, 68-76 

methods of solving, 42-51, 
95-102 

linearization, 21,522 
periodic solutions of, 544-554, 
565-577 

/'=/(*,/), 135 
y"=f(y,y'), 135 
Nonsingular matrix, 372 
Nullcline, 539 

Numerical dependence, 489 
Numerical methods, 451-481 
Adams-Bashforth formula, 
473 

Adams-Moulton formula, 474 
adaptive, 459,465,471 
backward differentiation 
formulas, 476-477 
backward Euler formula, 
455-456 

comparison of, 477 
convergence of, 456 
effect of step size, 458, 
482-483 

errors in, see Error 
Euler, 102-112,451-462,479 
Heun, 463 

improved Euler, 462-468 
modified Euler, 467 
multistep, 472-478 
one-step, 472 

predictor-corrector, 475,481 
Runge-Kutta, 468-472,479 
stability of, 485-490 
for stiff equations, 487-488 
for systems of first order 
equations, 478-481 
vertical asymptotes, 484-485 
Numerical stability, 485-490 

O 

One-step method, 472 
Orbital stability, 568 
Order of differential equation, 
20 


Ordinary differential equation 
definition of, 19 
Ordinary point, 254,266,270 
at infinity, 281 
Orthogonality 
of Bessel functions, 308 
of Legendre polynomials, 271 
of vectors, 372 
Overdamped motion, 200 

P 

Partial differential equation 
definition of, 19 

Partial fraction expansion, 319, 
322,323,327 

Particular solution, 177,226 
Pendulum equation 
generalized nonlinear 
undamped, 563 
linear undamped, 21 
nonlinear damped, 510-512, 
521,523-527,529 
nonlinear undamped, 21,25, 
26,518,528-529,555-556, 
559-560,563 
period, 530 
Period 

of nonlinear undamped 
pendulum, 530 
of simple harmonic motion, 
197 

Periodic functions 

Laplace transform of, 334 
Periodic solutions of 

autonomous systems, 
544-554,565-577 
Phase line, 81 
Phase plane, 206,396,496 
Phase plot, 206,218 
Phase portrait, 396,496 
Phase, of simple harmonic 
motion, 197 

Picard, Charles-Emile, 114 
Picard 

method of, 114 

Piecewise continuous function, 
310 

Pitchfork bifurcation, 94 


Poincare, Henri, 495,569 
Poincare-Bendixson Theorem, 
569 

Population dynamics, 78-88 
Positive definite function, 557 
Positive semidefinite function, 
557 

Power series, properties of, 
247-251 

Predator-prey equations, 20, 
544-554 

Predictor-corrector method, 
475,481 

Proper node, 499,523 

Q 

Quasi frequency, 199 
Quasi period, 199 

R 

Rossler equations, 585 
Rossler, Otto E., 585 
Radioactive decay, 17,62 
Radiocarbon dating, 62 
Radius of convergence, 248,267 
Ramp loading, 338 
Rate function, 5 
Rate of growth (decline), 5,79 
intrinsic, 80 
Rayleigh, Lord, 575 
Rayleigh equation, 575 
Rectified sine wave, 335 
Recurrence relation, 256,283, 
284,289 

Reduction of order, 171-172, 
226 

Reduction to systems of 
equations, 360 

Region of asymptotic stability, 
514, see also Basin of 
attraction 

Regular singular point, 277-281 
at infinity, 281 

Resistance, electric, 202, see also 
Damping force 
Resonance, 211,215,342-343 
Riccati, Jacopo Francesco, 134 
Riccati equation, 134 



Index 


643 


Rodrigues, Benjamin Olinde, 

271 

Rodrigues’ formula, 271 
Rosenzweig-MacArthur 
equations, 553,576 
Round-off error, 456,462, 
482-483 

Row reduction, 373 
Runge, Carl David, 468 
Runge-Kutta method, 468-472, 
479 

S 

Saddle point, 400,412,498, 

523 

Saddle-node bifurcation, 93 
Saturation level, 82 
Sawtooth wave, 335 
Scalar product, see Inner 
product 

Schaefer model for fish 
population, 91 
Schrodinger, Erwin, 345 
Self-adjoint 
equation, 158 
matrix, 387 

Separable equations, 27,42-51 
Separatrix, 514,526,538 
Series solution 

existence theorem for, 266, 
293 

first order equations, 270 
indicial equation, 284,289,293 
near an ordinary point, 
254-272 

near a regular singular point, 
282-296 

recurrence relation, 256,283, 
284,289 

when roots of indicial 
equation 

are equal, 286,292,294, 
297-301 

differ by integer, 286,292, 
294,301-305 

Shift of index of summation, 
251-252 

Similar matrices, 425 


Similarity transformation, 425 
Simple eigenvalues, 386 
Simple harmonic motion, 197 
Simply connected region, 96 
Simpson, Thomas, 469 
Simpson’s rule, 469 
Singular matrix, 372 
Singular point, 254,266, 

272-281 

irregular, 278,295-296 
regular, 272-281 
at infinity, 281 

Sink 

nodal, 497 
spiral, 501 

Slope field, see Direction field 
Solution of ordinary differential 
equation, 22 

general solution of linear 
equations, 12,37,74,141, 
150,162,169,176,223 
of systems, 392 
implicit, 74-75 
of systems of equations, 362 
Source 
nodal, 497 
spiral, 501 

Spiral point, 410,411,501,519, 
523 

Spring-mass system, 192-219, 
324,419 

three springs, two masses, 359, 
365,412-416,420 
two springs, two masses, 234 
Square wave, 334 
Stability 

asymptotic, 83,124,126,504, 
512,558,568 
definition of, 510 
see also Converging 
solutions 

basin of attraction, 514,526, 
539,560-562 

of critical point, 504,509-510, 
519,558 

exchange of, 94,127 
global asymptotic stability, 

527 


Liapunov theorems, 557 
for linear systems, 504,519 
for locally linear systems, 523 
of numerical method, 485-490 
orbital, 568 

region of asymptotic stability, 
514 

semistable, 89,568 
stable, 504,512,558,568 
definition of, 509 
unstable, 83,124,126,504,512, 
558,568 

definition of, 509 
see also Diverging solutions 
Stairstep diagram, 127 
Star point, 499 
Steady state solution, 64,210 
Stefan, Jozef, 63 
Stefan-Boltzmann radiation 
law, 63 

Step functions, 328 
Stiff equations, 487-488 
Stokes, George Gabriel, 66 
Stokes’ law, 66 
Strange attractor, 582 
Strutt, John William, see 
Rayleigh, Lord 
Successive approximations 
method of, 114,428 
Superposition principle, 147, 
364,391 

Sylvester, James, 368 
Systems 

of differential equations, 19 
autonomous, 508 
existence and uniqueness 
theorem, 362 
initial conditions, 362 
linear, 363 
nonlinear, 363 
numerical solution of, 
478-481 

reduction to, 360 
solution of, 362 
of first order linear equations, 
390-449,495-507 
definition of, 363 
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diagonalization, 426-427, 
440-442 

Euler, 405,418,436 
existence and uniqueness 
theorem, 363 
fundamental matrix, 
421-429,433 
fundamental set of 
solutions, 392,393 
general solution of, 392 
homogeneous, 363,390-396 
homogeneous with 

constant coefficients, 
396-440 

homogeneous with 

constant coefficients, 
complex eigenvalues, 
408-420,501-503 
homogeneous with 

constant coefficients, 
real and unequal 
eigenvalues, 396-407, 
497-498 

homogeneous with 

constant coefficients, 
repeated eigenvalues, 
429-440,498-500 
nonhomogeneous, 363, 
440-449 

nonhomogeneous, Laplace 
transform of, 446-447 
superposition of solutions, 
391 

undetermined coefficients, 

442- 443 

variation of parameters, 

443- 445 

of linear algebraic equations, 
378-381 


T 

Tangent line method, see Euler 
method 

Tautochrone, 356-357 
Taylor, Brook, 250 
Taylor series, 159,250 

for functions of two variables, 
467,521 

terminal velocity, 4 
Threshold models, 85-88 
Torricelli, Evangelista, 61 
Torricelli’s principle, 61 
Trajectories, 362,396,496, 
503-504,515-516 
almost linear systems, 523 
linear systems, 496-504 
locally linear systems, 524 
Transcritical bifurcation, 94 
Transfer function, 354 
Transfer matrix, 446 
Transient solution, 64,209 
Translation of a function, 330 
Transpose of a matrix, 369 
Truncation error 
global, 456,482-483 
local, 457 


U 

Undetermined coefficients, 16, 
177-186,236-240 
for systems of equations, 
442-443 

Uniqueness theorems, see 

Existence and uniqueness 
theorems 

Unit step function, 328 
Laplace transform of, 329 


V 

van der Pol, Balthasar, 570 


van der Pol equation, 570-573 
Variation of parameters, 28,41, 
186-192,241-245 
for systems of equations, 
443-445 
Vectors, 369 

inner product, 371 
length, 372 

linear dependence and 
independence of, 

382-383 
magnitude, 372 
multiplication of, 371 
orthogonality, 372 
Verhulst, Pierre F., 80 
Verhulst equation, 80 
Vibrations 

of spring-mass system, 
192-219,324,419 
of three spring, two mass 

system, 359,365,412-416, 
420 

of two spring, two mass 
system, 234 
Volterra, Vito, 545 
Volterra integral equation, 355 
Laplace transform of, 355 

W 

Wave equation, 19 
Wronski, Josef Maria Hoene-, 
149 

Wronskian, 149,223 
Abel’s formula for, 154,227 
for systems of equations, 392 
Abel’s formula, 393 

Y 

Yield, maximum sustainable, 91 



Elementary Laplace Transforms 



II 

i 

^7 

F(S) = £{/«} 

Notes 

1 . 

1 

5 > 0 

Sec. 6.1; Ex. 4 

2 . 

e at 

1 

- , s > a 

s — a 

Sec. 6.1; Ex. 5 

3. 

t n , n = positive integer 

n\ 

——r, 5 > 0 

5 n+1 

Sec. 6.1; Prob. 31 

4. 

t-H 

1 

A 

r(p + D 

-;— , s > 0 

SP +1 

Sec. 6.1; Prob. 31 

5. 

sin at 

a n 

2 , 2’ S > 0 
s z + a z 

Sec. 6.1; Ex. 7 

6 . 

cos at 

s 

O s > 0 

s 2 + a 2 

Sec. 6.1; Prob. 6 

7. 

sinh at 

a i i 

2 2 , *>|a| 

s z — a z 

Sec. 6.1; Prob. 8 

8 . 

cosh at 

s 

s 2 — a 2 ’ ,>|a| 

Sec. 6.1; Prob. 7 

9. 

e at sin bt 

(s-a) 2 + b 2 ’ S>U 

Sec. 6.1; Prob. 13 

10 . 

e at cos bt 

s — a 

(s — a) 2 + b 2 ’ S> ° 

Sec. 6.1; Prob. 14 

11 . 

t n e a \ n = positive integer 

n\ 

- 7 , s > a 

(, s - a) n+1 

Sec. 6.1; Prob. 18 

12 . 

u c (t) 

p-cs 

— , s> 0 

Sec. 6.3 

13. 

u c (t)f(t - c ) 

e~ cs F(s) 

Sec. 6.3 

14. 

e ct f(t) 

F(s — c) 

Sec. 6.3 

15. 

f(ct ) 

!'©• «*» 

Sec. 6.3; Prob. 25 

16. 

f f(t - r)g(r) dz 

Jo 

F(s)G(s) 

Sec. 6.6 

17. 

S(t - c ) 

e~ cs 

Sec. 6.5 

18. /W(r) 

s n F(s) s n ~ l f{ 0) /("-^(O) 

Sec. 6.2; Cor. 6.2.2 

19. 

(-07(f) 

F (n) (s) 

Sec. 6.2; Prob. 29 
















